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ABSTRACT 



Project TALENT is a large-scale, long-range 
educational research effort aimed at developing methods for the 
identification, development, and utilization of human talents, which 
has involved some 440,000 students in 1,353 public, private, and 
parochial secondary schools in all parts of the country. Data 
collected through teacher-administered tests, included some 2,000 
items of information about each student and some 1,000 items about 
each school. The student information included measures of (1) breadth 
of general information, (2) interests, (3) information in specific 
areas, (4) vocabulary, (5) motivational factors, and (6) scientific 
attitude. Other measures included those concerned with memory for 
sentences, the ability to use the English language, and tests dealing 
with creativity and mechanical reasoning. Use was also made of 
inventories to explore personality, vocational interests, and 
experiences. This information is in the computer processing stages 
and will provide data for later reports describing the schools these 
students attended and the interests, aptitudes, abilities, 
activities, and plans of the students. Anticipated continuing studies 
will be made at one, five, ten, and twenty years. (Author/JS) 
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This is the first oj a series of reports 
by the staff of Project TALENT. Sub- 
sequent reports will deal with the 
nature and quality of the American 
secondary school and with the apti- 
tudes and talents of American youth 
as revealed by the research described 
in this volume. 
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OVERVIEW 



Background of the Study 



o 

V, / n April 15, 1959, United States Commissioner of Edu- 
cation Lawrence W. Derthick signed a contract which officially 
initiated a large-scale, long-range educational research project to 
determine the best methods for the identification, development, 
and utilization of human talents. This study was to become 
known in all parts of the world as Project TALENT. 

Upon signing the contract, Commissioner Derthick said: “The 
purpose of the study is to find out why some students learn and 
others do not; why some students do poorly in high school and 
l then seem to come into their own in college, while others who 

i do well in high school fail to adjust to college. Here, on an un- 

precedented scale, is an attempt to find out more about the stu- 
dents’ interests, their career plans, and whether the courses they 
take are consistent with the life objectives they have set for 
themselves. And above all, it is an attempt to determine why so 
much of the nation's human potential is lost and what schools, 
( counselors and parents can do to reduce this loss.” 

F Dr, Derthick added: “For many years, educators have been 

seeking information on these important questions, and while 
l many studies have been conducted in school systems and on a 

I state-wide basis, a study of the magnitude proposed . . . seems to 

\ be a highly valuable way to throw . . . light on this subject. . . 

; In approving the contract for Project TALENT, Commissioner 

l Derthick acted under provisions of Public Law 531, passed by 

\ Congress in 1954. This unique piece of legislation set up a Co- 
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operative Research Program, authorizing the Commissioner of 
Education "to enter into contracts or jointly financed cooperative 
arrangements with universities and colleges . . . for the conduct 
of research , . . in the field of education" 

The Project TALENT contract provided for the allocation of 
funds to the University of Pittsburgh* Its signing was the culmi- 
nation of two years of planning by outstanding research workers 
in the field of education who served as consultants. 

Early in 1958, plans for collecting facts regarding the identifi- 
cation, development, and utilization of human talents were al- 
ready under way at the University of Pittsburgh. These plans at- 
tracted the interest and support of a number of government 
agencies. Among groups providing financial help at that time 
for the planning phases of the study were the National Science 
Foundation, National Institute of Mental Health, and the Office 
of Naval Research. These agencies had expressed interest in the 
study and wished to share in its support in order to use the find- 
ings in planning their own programs. However, as activities 
under Public Law 531 gathered momentum, these agencies rec- 
ommended that the research on talent be carried out under the 
auspices of the Cooperative Research Program, at that time 
headed by Dr. Roy M. Hall, Assistant Commissioner of Research 
of the United States Office of Education. 

Under law, the Cooperative Research Program is guided by a 
Research Advisory Committee whose function is to review re- 
search proposals submitted to it, and to judge them "as to the 
soundness of their design, . . . [and] the possibilities of securing 
productive results, . . 

In February, 1959, the Research Advisory Committee was 
headed by Dr. Ralph W, Tyler. Dr. Tyler had been sympathetic 
from the start toward the main purposes of Project TALENT. 
But he and his group required, as an official procedure, specific 
descriptions of the main areas which Project TALENT was to 
study and the national needs which made such a study neces- 
sary, In response to this requirement, the University of Pitts- 
burgh submitted formal proposals for a study designed to collect 
data from a scientifically selected sample of almost half a million 
students in secondary schools in all parts of the United States. 
The facts to be collected from this group of American youth, the 
proposals stated, were urgently needed to throw more light on 
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seven areas of national concern. Below Is the bill of particulars 
highlighting theso seven areas and the reason an fnqulry was 
Important In each; 

1. Available talent . 

More precise information is needed as to the size of tho 
manpower pool qualified for training in science, engineering 
and other professional fields. 

2. Relations among aptitudes, interests, and other factors . 

Available knowledge is particularly deficient with respect 
to the interrelation patterns of aptitudes, preference, interests, 
socio-economic factors, and motivational factors. 

3 . Limiting effects resulting from lack of interest and motivation . 

Specific information is needed regarding tho extent to which 
people qualified for training in scientific and professional 
fields lack interest and motivation for obtaining this ItpJning. 

4. Factors affecting vocational choice . 

More information is needed regarding the djnamics of per- 
sonal decisions and environmental factors which ultimately 
determine the individual’s occupational career pattern. 

5. Predictors of creativity and productivity . 

Better information is needed with respect to the relation of 
aptitude, interest, and motivational factors to creativity and 
productivity in particular professional fields. 

6. Effectiveness of various types of educational experience . 

Basic information is needed regarding the effectiveness of 
various types of educational experience in developing special 
talents, 

7. Procedures for realizing individual potentials. 

The final overall requirement is for sound information re- 
garding procedures for assisting the individual to realize his 
highest potential. 

After reviewing the proposals for Project TALENT, Dr. Tyler 
and his Research Advisory Committee met in Washington for a 
three-day session (February 12 to 14, 1959) to discuss them 
cdong with proposals for other research studies. It was at this 
meeting that the Committee recommended to the Commissioner 
of Education that Project TALENT was worthy of support by 
the United States Office of Education. 
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Project TALENT was designed to help provide answers to 
what Commissioner Dcrthick described in 1059 as "one of the 
most crucial problems In education” However, tho origins of 
the project go back to another critical time In the history of the 
nation — World War 11. In 1941, when this country was mobilis- 
ing its manpower resources and was faced with the problem of 
identifying the young men who could be trained to fill many 
wartime duty assignments, a young psychologist. Dr. John C. 
Flanagan, was commissioned as a major in the Army Air Forces 
to direct tho classification activities of the Aviation Psychology 
Program. 

His first and most urgent assignment was to devise procedures 
for identifying and training the tens of thousands of cadets re- 
quired to man the places needed to meet the challenge of tho 
Nazi and Japanese air forces. To meet these demands, the tra- 
ditional educational requirements for aviation cadet training were 
eliminated; new selection and classification procedures based on 
aptitudes for each type of Job were developed. 

Under the new procedures, young men who qualified on tho 
first mental and physical screening tests given by the Aviation 
Cadet Boards were sent to Aircrew Classification Centers. Here 
they were given a battery of aptitude classification tests which 
required a day and a half to complete. In addition to serving as 
a classification Instrument, this battery of 20 tests also l)ccamo 
tho subject of continuous study, evaluation, and refinement 
throughout tho war. 

In 1643 Lt. Colonel Flanagan and his Air Force psychologists 
decided to sco how well tho 20 tests predicted tho future per- 
formance of young men in intensive emergency pilot training. 
Ono thousand applicants who had passed tho first physical 
screening tests v.cro accepted and sent into pilot training regard- 
less of their qualifications as indicated on the aptitude classifica- 
tion tests. 

Tho value of the tests was dramatically demonstrated when 
only sixteen out of tho 442 men who had tho lowest pilot aptitude 
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seorps successfully completed pilot training. By contrast, nearly 
all those with the highest pilot aptitude scores successfully com* 
pletcd the pilot training courses, 

The predictive value of these tests saved hundreds of mlll'ons 
of dollars In training costs and greatly Increased the quality of 
performance of pilots sent Into combat Of even greater long* 
range significance was the large-scale demonstration of the prac- 
tical Importance of various patterns of aptitudes. 

The results In the Aviation Psychology Program In World War 
)! clearly Indicated that the aptitudes Important for success In 
one fob were often quite different from those In another job. In- 
dividuals who failed to solo In primary pilot training because of 
extreme ineptness frequently were later graduated at the top of 
their class in navigation training. 

After returning to civilian life, the Air Force psychologists 
tsegan to study civilian jobs In terms of aptitudes and abilities 
required for success. They identified the requirements for differ- 
ent types of jobs, and developed tests to predict effective per- 
formance in the tasks important for these jobs. 

But there are hundreds of different kinds of jobs tn the civilian 
labor market; and follow-up studies in civilian life are expensive 
and time-consuming. So, even though in the 1050s public de- 
mands for better guidanoe programs for students began to In- 
crease, the data required to match talents and tasks with a high 
degree of confidence were not available. 

In 1057 the United States was jolted try the challenge of totali- 
tarian technological advances. And at the same time, our country 
found Itself possessing new tools for developing our human re- 
sources. Scientific breakthroughs in electronic data processing 
made it feasible to do long-range studies on large populations. 
Newly-developed tests appeared to provide measures for all the 
important job elements that had been identified in post-war 
studies of critical job requirements. Atxwc all, piddle opinion 
recognized tht increasing national need for scientific methods in 
improving education, creativity, and productivity. Leaders in 
government and education recognized, too, the need for new- 
information, without which orderly progress in developing human 
resources would he impossible. 
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In 1957. Colonrl John C. Flanagan, now professor of psychol- 
ogy at the University of Pittsburgh and president of the American 
Institute for Research, developed a proposal for a study of suffi- 
cient scope to provide the United States with the kinds of In- 
formation critically needed by education, Industry, government, 
and the military service*. A* noted earlier, this proposal wa* sub- 
mitted to a numlier of foundations and government agencies. 
After a series of conferences, the National Science Foundation, 
the National Institute of Mental Health, the Office of Naval lie- 
search, and the Cooperative Research Program of the United 
States Office of Education agreed In October, 1957, to support a 
planning study to investigate the feasibility of the project and to 
develop detailed procedures for carrying it out Two >cai* of 
review and planning followed. 

After consulting with many Individuals and group*- four ad- 
visory panels were established in March, 1958. The panel mem- 
ber* were selected to he a* competent and representative as pos- 
sible. The original chairman of the combined groups was Dr. 
John 11. Fischer, then Superintendent of the Baltimore Public 
Schools. When Dr. Fischer became dean of Teachers 'College, 
Columbia University, the chairmanship was assumed by Dr. 
Kenneth E. OlrcrtoltTcr, Superintendent of the Denver Public 
School*. The list of advisory panels and the members of each is 
as follows: 



Advisory Panels 

Guidance and CountcllnR Panel 
Chairman (Initial), Dr. Donald E. Super, Professor of Edu- 
cation, Department of Psychological Foundations and Serv- 
ices, Tea cl let* College, Columbia University 
** Chairman, Ed -van! Landy, Director, Division of Counseling 
Services, Newton (Massachusetts) Public School* 

Ralph F. Berdic, Director, Student Counseling Bureau, Uni- 
versity of Minnesota 

Bruce E. Shear, Chief, Bureau of Guidance, New York State 
Education Department 

John M. Slalnaker, President, National Merit Scholarship Cor- 
poration 
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David Vi Tiedcman, Associate Professor of Education, Har* 
vatd University 

Aithur E, Traxler, Executive Director, Educational Records 
Bureau 

Leona E, Tyler, Professor of Psychology, University of Oregon 
Testing Problem# Panel 

Chairman, Holiert L, Thorndike, Head, Depaitment of Psy- 
chological Foundations and Services, Teachers College, Co* 
lumbia University 

Henry Chauncey, President, Educational Testing Service 

Wayne H, Holtzman, Associate Director, Hogg Foundation, 
University of Texas 

A, Paul Horst, Professor of Psychology, University of Wash* 
Ington 

Lloyd G, Humphreys, Chairman, Department of Psychology, 
University of Illinois 

Ei Lmvcll Kelly, Director, Bureau of Psychological Scrvioci, 
University of Michigan 

Joseph Zubin, Principal Research Scientist, Biometrics Re- 
search Unit, New York State Department of Mental Hygiene 

Educational Research Panel 

Chairman, Bobcrt J, Keller, Director, University High School, 
University of Minnesota 

Frank D, Ashbum, Headmaster, Brooks School (Massachu- 
setts) 

••Pad Li Banflcld, Headmaster, Landcm School (Maryland) 

Hc\ '•rend O’Neil C. D’Amour, Assistant to the Executive Sec- 
retary, National Catholic Education Association 

Warren C. Findley, Assistant Superintendent for Pupil Per- 
sonnel Services, Atlanta Public Schools 

Earl J, McGrath, Professor of Education, Teachers College, 
Columbia University 

Paul T. Rankin, Assistant Superintendent of Schools, Detroit 
Public Schools 

James W. Reynolds, Professor of Education, University of 
Texas 

J. Wayne Wrlghtstone, Director, Rureau of Educational Re- 
search, New York City Board of Education 

Maniwwer and Sociology Panel 
• Chairman, Samuel A. Stauffer, Director, Laboratory of Social 
Relations, Harvard University 
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K. Franklin Frazier, Head, Department of Sociology, Howard 
University 

Seymour E. Harris, Chairman, Department of Economics, Har- 
vard University 

• Irving D. Lorgc, Executive Officer, Institute of Psychological 

Research, Teachers College, Columbia University 

Donald G. Marquis, Massachusetts Institute of Technology 

C. Joseph Nucssc, Dean, School of Social Science, Catholic 
University of America 

Fred L. Strodtbcck, Associate Professor of Sociology, University 
of Chicago 

* Deceased 

•* Replacement 

During the first year, Dr. Robert C. Craig was the only full* 
time member of the staff. In June, 1958, Dr. John T. Dailey rc* 
placed Dr. Craig as the full-time director of the project Other 
staff members who worked with Dr. Dailey included Miss Marion 
F. Shayooft, and Drs. William A. Gorham, David D. Orr, and 
Isadorc Goldberg. The staff worked closely with the advisory 
panels who met in Washington for a scries of two-day planning 
sessions. 

By December, 1958, the various advisory panels had made 
their final recommendations, (he planning study was completed, 
and the revised proposal was submitted to the Cooperative Re- 
search Program of the United States Office of Education. The 
Research Advisory Committee of that Program recommended 
that the study be given support. Commissioner Derthick re- 
viewed tho recommendations, concurred in the advice of tho 
Committee, and in April, 1959, signed the contract for Project 
TALENT. The staff of the U.S. Office of Education continued its 
support and assistance to the project under Commissioner 
Sterling M. McMurrin. 

Work began immediately. Tho advisory panels had recom- 
mended using a two-doy battery of tests specifically developed 
for tills project. Tho staff had already begun work on the ma- 
terials. After these materials wero roviewed by the panels, the 
experimental forms of tho tests were tried out in May, 1959, in 
eleven high schools in five states. 

It 'vos agreed that tho final forms of tho tests would bo given 
to nearly half a million students in secondary schools throughout 
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the country. The task of simultaneously testing so large a num- 
ber tn widely separated parts of the country posed great admin- 
istrative problems. Once the scientifically stratified random sam- 
ple of schools had been selected It became necessary to enlist the 
help of school superintendents, principals, and teachers all over 
the United States. On the basis of the geographic locations of 
the various schools selected for the sample, 90 regional coordi- 
nators were appointed to work with the educational pet sound at 
state, dty, and school levels who were responsible for the sec- 
ondary schools that had been selected for participation In Project 
TALENT. These regional coordinators assumed responsibility 
for coordinating and assisting in administering the two-day test 
battery. They also collected data about these schools, thdr cur- 
ricula, staff, guidance programs, and future plans. The regional 
coordinators for Projed TALENT Included: 

IluctoNAt. CoonniXATons 



Alabama 

Paul R. Givens, Rirmlngham-Soulhcm College 

Herlrcrt liber, Birmingham 
Arizona 

Richard E. Schutr, Arizona State University, Tempo 
Arkansas 

Caller Short, University of Arkansas, Fayetteville 

Hardy C. Wllcoxon, University of Arkansas, Fayetteville 
California 

Alex D. Aloia, Loyola University’ of Los Angeles 

John Cafircy, Director of Research, Palo Alto Unified School 
District 

Frederick J. McDonald, Stanford University, Palo Alto 
Colorado 

Anthony C. Tucker, University of Denver 
Connrcflctd 

Joseph Raymond Cetberich, University of Connecticut, Storrs 
Delaware 

Arthur R. DeLong, University of Delaware, Newark 
District of Columbia 

William A. Gorham, University of Pittsburgh 
Florida 

Edward Caldwell, Board of Public Instruction, Manatee County, 
Bradenton 

John V. McQuitty, University of Mori da, Cnlnetvdlo 
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Georgia 

Cameron Fincher, Georgia State College for Business Admin- 
istration, Atlanta 

C. H. ForS Board of Education, Atlanta 
Richard H. Klckllghter, Gainesville, Florida 
R. T. Osborne, University of Georgia, Athens 
Idaho 

Elvvyn DeLaurler, State Guidance Supervisor, Department of 
E ucatlon, Boise 
lUinoi n 

N. L. Cage, University of Illinois, Champaign 
Lyman J. Smith, Illinois State Scholarship Commission, Deer- 
field 
Indiana 

N. A, F'attu, University of Indiana, Bloomington 
IL H* Rcmmcrs, Purdue University, Lafayette 
Iowa 

Arthur Mittman, University of Iowa, Iowa City 
Gondon J. Rhum, Iowa State Teachers College, Cedar Falls 
Herbert M. Silvcy, Iowa State Teachers College, Cedar Falls 
Kansas 

Kenneth E. Anderson, University of Kansas, Lawrence 
Charles B. Watkins, Guidance and Personnel Service, Kansas 
State Department of Public Instruction, Topeka 
Kentucky 

Ernest McDaniel, University of Kentucky, Lexington 
Ixnil&iana 

Robert N. Vidulich, Louisiana State University, Baton Rouge 
Maine 

David R. Fink, Jr., University of Maine, Orono 
Maryland 

Robert C. Lloyd, Baltimore Public Schools 
Massachusetts 

Seth Arscnian, Springfield College 
George S* Ellas, Springfield Collcgo 

Edward Scanlon, Division of Counseling Services, Newton Pub- 
lic Schools, West Newton 
Michigan 

Cloudo L. Ncmzck, University of Detroit 
• Edwin G. Spado, Central Michigan University, Mt. Pleasant 
Buford Stefllro, Michigan State University, East Lansing 
Frank B, Womer, University of Michigan, Ann Arbor 
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Minnesota 

Ralph F. BcrdJo, Director, Student Counseling Bureau, Uni- 
versity of Minnesota 

Robert J. Keller, Director, University High School, University 
of Minnesota 
Mississippi 

Roscoo A, Boyer, University of Mississippi, University 
Russell W. Levanwny, Millsaps College, Jackson 
Missouri 

Joseph L. French, University of Missouri, Columbia 
Robert E. Lefton, Psychological Associates, Clayton 
Montana 

William A. Garrison, Eastern Montana College of Education, 
Billings 
Nebraska 

Warren Bailer, University of Nebraska, Lincoln 
New Hampshire 

Paul Mclntire, University of New Hampshire, Durham 
New Jersey 

Albert S. Thompson, Teachers College, Columbia University, 
New York 
New Mexico 

Virginia Keehan, Department of Education, Santa Fe 
New York 

Warren W. Coxe, Delmar 
S. David Farr, University of Buffalo 
Harold Howes, Milne High School, Albany 
John M. Skalski, Fordham University, New York 
0 Percival M, Symonds, Professor Emeritus, Teachers College, 
Columbia University, New York 
Clarence M. Williams, University of Rochester 
North Carolina 

Roy N. Anderson, North Carolina State College, Raleigh 
Junius A. Davis, University of North Carolina, Greensboro 
Thomas E. Jeffrey, University of North Carolina, Chapel Hill 
William D. Perry, University of North Carolina, Chapel Hill 
North Dakota 

Ralph H, Kolstoe, University of North Dakota, Grand Forks 
Robert E. Larson, State Agricultural College, Fargo 
Grant M. Norem, State Teachers College, Minot 
Ohio 

Howard B, Lyman, University of Cincinnati 
Walter S, Nosal, John Carroll University, Cleveland 
Ray Wood, Columbus 
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Oklahoma 

W. R, Brown, University of Oklahoma, Norman 
Oregon 

J. Spencer Carlson, University of Oregon, Eugene 
Pennsylvania 

L. Kathryn Dice, Department of Public Instruction, Harrisburg 
Roy B. Hackman, Temple University, Philadelphia 
C. Mauritz Lindvall, University of Pittsburgh 
Rhode Island 

Frances E. Dunn, Brown University, Providence 
South Carolina 

R. L. Kalmbach, Columbia Public Schools, Columbia 
W. C. McCall, University of South Carolina, Columbia 
Donna S. Young, University of South Carolina, Columbia 
South Dakota 

V. Gregory Rosemont, Huron College, Huron 
Tennessee 

George E. Copple, Vanderbilt University, Nashville 
Louise W. Cureton, Knoxville 
Texas 

Robert P. Anderson, Texas Technological College, Lubbock 
H. Paul Kelley, University of Texas, Austin 
Saul B. Sells, Texas Christian University, Fort Worth 
Franklin L. Stovall, University of Houston 
David F. Votaw, Sr., San Marcos 
Utah 

Hyrum M. Smith, Department of Public Instruction, Salt Lake 
City 
Virginia 

Richard L, Beard, University of Virginia, Charlottesville 
Donald J. Herrmann, College of William and Mary, Williams- 
burg 

Washington 

William C, Budd, Western Washington College of Education, 
Bellingham 

Glen E, Maier, Eastern Washington College of Education, 
Cheney 
West Virginia 

Walter Jarecke, University of West Virginia, Morgantown 
Wisconsin 

Elden A, Bond, Milwaukee Public Schools 
Robert C. Craig, Marquette University, Milwaukee 
Ralph H, Tindall, Milwaukee Public Schools, Milwaukee 
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Wyoming 

R. Duano Andrews, Department of Education, Cheyenne 

0 Deceased 

The thinking and planning of the Project TALENT staff were 
also guided by an Advisory Council. The Council held two meet- 
ings, the first in November of 1959, the second in November of 
1960. Following are the names of those who attended one or 
both of these meetings: 

Dugald S. Arbuckle, President, American Personnel and Guid- 
ance Association 

Brother Bartholomew, CFX, President, Secondary School Dept., 
National Catholic Education Association 

Charles F. Carroll, President, Council of Chief State School Offi- 
cers 

The Rt. Rev. Msgr. O’Neil D’Amour, Associate Secretary cf the 
School Superintendent’s Department, National Catholic Edu- 
cation Association 

Roy O. Frantz, President, National School Boards Association 

Edgar Fuller, Executive Secretary, Council of Chief State School 
Officers 

Arthur A. Hitchcock, Executive Secretary, American Personnel 
and Guidance Association 

Paul E. Klopsteg, President, American Association for the Ad- 
vancement of Science 

Chauncey D, Leake, President, American Association for the Ad- 
vancement of Science 

Kenneth E, Oberholtzer, Superintendent, Denver Public Schools 

W. A. Shannon, Executive Director, National School Boards As- 
sociation 

George E, Watson, President, Council of Chief State School 
Officers 

Dael Wolfle, Administrative Secretary, American Association for 
the Advancement of Science 



4 

The year 1960 was a census year. The United States govern- 
ment was taking inventory of the number of persons who made 
up the population of the country. This census provided statistics 
on the total number of people and their major characteristics. It 
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seemed propitious that 1960 also was the year for Project TALENT 
to launch the first national census of the aptitudes and abilities of 
the young people in the secondary schools of the country. 

To provide professional advice on the selection of a representa- 
tive sample of schools and institutions, the staff enlisted the aid 
of a committee of sampling experts. This group consisted of 
Morris H. Hansen, Assistant Director for Research and Develop- 
ment, Bureau of the Census; William G. Cochran, Professor of 
Statistics, Harvard University; Phillip J, Rulon, Professor of 
Education, Harvard University; and Frederick F. Stephan, Pro- 
fessor of Social Statistics, Princeton University. 

By January of 1960 all the tests had been prepared and hied 
out. Ninety-three per cent of the schools selected had indicated 
their willingness to participate in the project and the administra- 
tive arrangements for testing had been made with the schools. 

In March of 1960, some 440,000 students in 1,353 public, pri- 
vate, and parochial secondary schools in all parts of the country 
took the Project TALENT tests. The work of the regional co- 
ordinators in cooperation with state, city, and local school officials, 
and with teachers had been a success. The first data collec- 
tion phase of Project TALENT was completed when the class- 
room teachers, in cooperation with school guidance counselors, 
administered the tests to the students, collected the answer 
sheas, and returned them to the Project TALENT test scor- 
ing headquarters at the Measurement Research Center at the 
State University of Iowa. There Dr. E. F. Lindquist directed the 
massive job of scoring, recording, and reporting the more than 
one billion bits of information collected from the students. 
Rosters of scores made on all tests by the students who partici- 
pated in the project were sent to their individual schools. 

At the same time, the staff of Project TALENT began to ana- 
lyze the data — an undertaking which will provide the informa- 
tion to help America reassess its educational program and its 
human resources. 
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Importance 



Understanding 



Talent 



Our nation pays a high price for its inadequate un- 
derstanding of talent. Therefore, we begin by explor- 
ing the background and issues of three questions: 
What is talent? How can it be developed? How can 
the individual make the best use of his talents? 

We discover that talent does not consist of intelli- 
gence alone. We recount the famous war-time experi- 
ment of the Air Force in which a new concept of talent 
contributed to victory. We outline the need for a more 
widespread application of the lessons of the Air Force 
experience. 

Finally, we examine briefly a most important agency 
in the United States for the development of talent — 
the secondary school; and we meet Robert, one of a 
half million young persons, whose pattern of aptitudes 
and abilities will either be developed or neglected in 
the years ahead. We state that the purpose of our 
study is to see how Robert’s talents (and those of all 
American youth in the future) can be brought to a 
point of high productivity and usefulness. 
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I lie physical scientist who explores molecular patterns with a 
beam of X-rays and the behavioral scientist who explores a stu- 
dents intellectual patterns with a series of objective test items 
arc engaged in tasks of similar challenge. The physical scientist 
probes the mysteries of the molecule. The behavioral scientist 
seeks to pierce the riddle of man's intellect. Both face cosmic 
enigmas and work under an identical urgency to gain under- 
standing of the forces of nature. 

The pattern of the beam of X-rays os diffracted by the mole- 
cules of a crystal is indistinct. The physical scientist must do 
considerable estimating — checking and rcchccking his computa- 
tions with high-speed electronic computers — before lie can draw 
a model of a complex molecule. 

A student's pattern of answers to test questions is usually even 
more difficult to interpret, and many samples arc required before 
the profile of the student's capacities and limitations can be even 
tentatively estimated. 

Difficult though the task of interpreting the many sample: of 
a student's talents may be, each young person needs a clear pic- 
ture of himself if he is to develop his highest potentials. A na- 
tion, too, needs a clear picture of the total talents and abilities of 
iii people. Such a picture can come only from the scientific study 
of man. Such study is now possible. Our tools and methods for 
the scientific study of man are still crude, crude os the undent 
Chinese abacus, yet there is no reason to abandon or condemn 
them. Without the abacus, high-speed electronic computers 
could not have been developed. 

Limited as our methods for the study of people arc, they are 
beginning to yield important and useful concepts for the im- 
provement of our behavior, our institutions, and our modes of 
thinking. Equally important is the fact that wo now know the 
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directions in which our investigations of people should move. 
We know the avenues to explore. 

One of the most important of these tasks is charting the com- 
plex intellectual patterns which determine those fields in which 
a man can perform, achieve, and create. 

Tills is the task with which we in Project TALENT have con- 
cerned ourselves during the past two years. It is a task wo shall 
continue to pursue for the next decade and longer. But even 
now some promising results arc beginning to emerge. To under- 
stand these, as well as the research findings that will become 
available over the next several years, it will be necessary to un- 
derstand the conditions which led to the plans wo developed and 
the questions wo hope to answer. 

One important factor is that our lack of definitive knowledge 
of the capabilities of men is a serious handicap to the nation — 
its industries, armed forces, professions, and arts and sciences. 

The employer who assigns a $10,000-a-ycar engineer to draft 
the design specifications that a $7,000-a-ycar draftsman could do 
better and with greater satisfaction to all involved is wasting 
money and talent. 

The college admissions officer who looks only at a high school 
graduate's grades and scholastic test scores is seeing just part of 
the student. How many young people with outstanding specific 
aptitudes arc being overlooked by colleges and universities be- 
cause of our inadequate measures of potential ability? 

The guidance counselor who has no tools for predicting 
whether Johnny will have greater success in accounting or in 
mechanics falls short of performing a service much needed by 
Johnny, industry, and the nution. 

The civil service official who insists that only “persons of high 
intelligence" can qualify for jobs in which clerical ability is more 
important than broad mental powers is wasting the taxpayers' 
money and vitally needed manpower resources. 

Wo could give hundreds of examples of waste, misuse, and 
abuse of human ability. Taken together, the national waste of 
human resources is appalling. Anyone assigning a dollar value 
to the squander of human talents will bo wide of the mark — 
and there is no way to begin to c:timatc the additional cost in 
frustration and unhappiness for the individuals whose time and 
effort go into activities which bring them little satisfaction. 
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Can these losses be turned Into gains? Searching for ways and 
techniques to accomplish this is one of tho purposes of Project 
TALENT, We tire not alone in this search, Much has already 
been done, and much related work is continuing in the United 
States and in other parts of tho world, The efficient application 
of tho talents of each man, woman, and child is the concern of 
governments as well as parents, teachers, psychologists, personnel 
directors, and military officers. 

There are three fundamental questions \vc must answer: What 
is talent? How can it be developed? llow can an individual 
mako the best use of his talents? 
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What is talent? 

The definition of talent in a primitive tribe is likely to be quite 
simple, Where the tribe depends primarily on hunting wild game 
for survival, the definition of talent will focus on the ability to 
become an outstanding hunter. To the warring tribe, the ability 
to carry battle to the enemy is most prized. 

Even nations which produced men whose brilliant insights and 
ideas are still recognized today had a limited view of mans 
talents. The Greeks honored the orator and the artist — but 
failed to appreciate the inventor, Rome cherished the soldier 
and the administrator — but failed to recognize the many other 
potential talents of either its citizens or its slaves. 

What is our present concept of talent and how has it devel- 
oped? It is not surprising that a complex society such as ours 
has a complex view of talents. But events of die recent past 
strongly emphasize that the systematic study of talent is still in 
its infancy. Some progress lias been made in gaining the under- 
standing essential to the development of a science of human be- 
havior, However, let us review its most recent stage of develop- 
ment. Even now the effects of the period of oversimplification of 
the concept of talent linger in many places. 

This oversimplified concept of the basis of talent was the 
theory of general intelligence. This theory might be regarded as 
representing a stage of development roughly analogous to that of 
the early theory of phlogiston in the physical sciences. Although 
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the phlogiston theory has been abandoned, it was a milestone of 
man's progress from alchemy to our present concepts of physical 
science. 

The phlogiston theory was developed by two German chemists, 
Johann J. Becher and Georg E. Stahl, in the latter part of the 
seventeenth century. It was Stahl who formalized and named its 
components. The phlogiston theory stated that metals were com- 
posed of a calx, different for each metal, and phlogiston which 
was the material of fire and which was consumed when a com- 
bustible substance burned. This theory was widely accepted for 
nearly a century because it appeared to provide a neat explana- 
tion for many of the observed characteristics of combustion. The 
careful quantitative studies of the English scientist, Henry Cav- 
endish, revealed many weaknesses in the phlogiston theory; but 
even Cavendish never quite discarded the theory entirely. Late 
in the eighteenth century, the French chemist, Antoine L. 
Lavoisier, described the nature of chemical elements essentially 
as they are known today and is generally credited with having 
replaced the out-moded phlogiston theory with a more useful 
one. 

Let us trace the parallel development and replacement of the 
theory of general intelligence. Early in the 1900's Alfred Binet, 
the French psychologist, began working on a set of practical 
tests of intellect. Binet studied examples in which the higher 
mental processes were exhibited in handling simple, practical 
problems. 

Following the work of the great English social scientist, Francis 
Galton, Binet worked toward establishing individual psychology 
on a scientific basis by trying out his tests on writers, artists, 
mathematicians, and chess players, as well as school children. 
The scales for the measurement of intelligence and educational 
attainment which he developed and prepared for the school chil- 
dren of Paris were copied all over the world. They have been 
widely used in the measurement of intelligence in this country 
in the series of revised forms prepared by Lewis M. Terman and 
his associates, and known as the Stanford-Binet tests of intelli- 
gence, Binet’s tests had a profound effect throughout the world 
because they provided a series of tasks standardized according 
to the average age at which they could be successfully performed 
by most children. In this way, a scale of mental ages was pro- 
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vJdcd which later led to a method for obtaining the ratio of 
mental to chronological age, known a * the Intelligence Quotient 
or I.Q. This convenient ratio, which conveys essentially the samo 
meaning regardless of a child’s chronological age, prodded a 
useful index which was universally adopted os the standard pro* 
oedure for describing the level of a child’s intellectual potential. 
Binct’s original scale was intended only as a practical, useful 
test, and he did not draw theoretical implications from Ills 
findings. 

The theoretical case for general intelligence came from the 
work of Charles Spearman, who retired from an active military 
career in the British army to study the new field of psychology 
in Germany. He received his Ph.D. degree at tho ago of 40. 
When Spearman returned to England he foined a group at Ox- 
ford University who were using Karl Pearson’s recently devel- 
oped mathematical index — the correlation coefficient — for 
studying the relations between various test scores and other 
measures of ability. The group at Oxford was formed to develop 
tests of intelligence to be used in a projected survey of British 
schools planned by Francis Galton. 

Spearman’s work on this project led him to publish a paper in 
1904 entitled, “General Intelligence: Objectively Determined and 
Measured.’’ At about this same time, Btnet was publishing his In- 
telligence Seales for use with the school children of Paris. Spear- 
men studied the correlations between the scores on a wide variety 
of tests, school grades, and teachers’ ratings and concluded that all 
such performance was dependent on the amount of general in- 
telligence which the individual possessed, plus a second factor 
which was different for each type of content (verbal, numerical, 
eta). Thus, all forms of human behavior were to be explained 
by (1) a factor specific to the content, paralleling the calx of 
each metal in the phlogiston theory, and (2) general intelligence, 
called "g.” Spearman’s “g” was, in effect, tho common element 
in human performance, analogous to the phlogiston supposedly 
common to all metals. 

These notions, gradually discarded, had at least one beneficial 
outcome. American researchers of individual differences, includ- 
ing Karl J. Holzingcr, Truman Leo Kelley, L. L. Thurstonc and 
J. P. Guilford, were attracted by tho objective ncasurcs and pre- 
cise statistical analyses that were an important part of the “g” 
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theory. They were stimulated to study the dimensions of In- 
tellect. 

Strong support for Spearmans theory came from a new source 
— the success of the Binet Seales and the Army Alpha Group 
Tests of Intelligence used to classify men In World War I. Fol- 
lowing World War I, Arthur S. Otis and others published group 
tests of general intelligence which made it convenient and in- 
expensive to obtain estimates of the I.Q.'s of large numbers of 
students. These developments established general intelligence 
and the I.Q. as the sole and exclusive indicators of aptitude and 
intellectual ability, at least in the popular mind. However, a few 
psychologists, notably Truman Lee Kelley at Harvard, and L. L. 
Thurstonc at the University of Chicago, had doubts that "g,” or 
general intelligence, the phlogiston of Spearman's theory, was 
indeed the universal factor that Spearman presumed it to be. 

• Through the work of Kelley and Thurstone, several mental 
factors were established. These included: memory, reasoning, 
ability to do simple arithmetic, to understand word meanings, to 
note small changes in visual details, and to identify objects which 
lmd been rotated. 

In spite of these promising research studies, general intelli- 
gence was still the basis for nearly all practical testing of intellect 
in 1941, when a group of younger psychologists were invited into 
the military service to assist in selecting and classifying young 
men for training as aviation cadets. The psychologists directing 
this work had been students of Kelley and Thurstone and they 
immediately began planning, developing, applying, and testing 
the multifactor theories in an effort to help the Army Air Forces 
with the task of defending America. 
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To meet the blows of Hitler's Luftwaffe, the U. S. Army Air 
Forces had to recruit hurriedly, train, and send into combat large 
numbers of aircrews. Pilot, navigator, bombardier — these three 
constituted a flying team, and on their skill depended much of 
America's security from 1941 to 1945. The pilot was the leader 
of the three; young men vied for the honor and challenge of the 
pilot’s job. Applicants for flight training were selected on tradi- 



TIIE IMPORTANCE OF UNDERSTANDING TALENT 



23 



tional criteria at that time — the number of years spent in school 
or college, and scores on general intelligence or screening 
tests* Those who failed in pilot training were considered for 
training as navigators or bombardiers* 

This was wasteful and inefficient; it ignored the nature of the 
various tasks which members of an aircrew had to perform. That 
was the argument used by the group of psychologists who were 
working on the selection problem for the Army Air Forces. The 
theories they tested in a series of studies were later reported in 
the Research Reports of the Army Air Force Aviation Psychology 
Program. These studies first demonstrated the feasibility of large- 
scale programs of the type proposed for Project TALENT. 

First the psychologists took a long, hard look at the types of 
tasks which each man in an aircrew had to perform. They deter- 
mined that the tasks were distinctive — they differed for each of 
the three jobs, and they required distinctive aptitudes. For 
example, the pilot required a high degree of understanding of 
mechanical principles in order to be able to visualize the re- 
sponses of planes to controls and special conditions; the navi- 
gator needed special aptitude for interpreting charts, maps, and 
gauges; the bombardier needed to be skillful in identifying 
specific patterns and objects (enemy gun installations or muni- 
tions factories) from high altitudes. 

The Air Force psychologists established the fact that a different 
pattern of job elements was critical to the success of each of the 
three types of aircrew jobs. They tackled the problem of identi- 
fying these particular patterns of aptitudes in the thousands of 
applicants who were eager to enter flight training — to find the 
men best suited for each of these three vital assignments. 

In answer to this need, they developed the Aircrew Classifica- 
tion Tests — tests to measure each of the aptitudes required for 
effective performance in the three aircrew jobs. This battery of 
twenty aptitude and ability tests was administered to hundreds 
of thousands of young men before the war ended in 1945. 

The Air Force psychologists worked on the theory that young 
men who scored high in tests of pilot aptitude could successfully 
complete pilot training; that those whose scores for pilot aptitude 
were low should not be sent into training since they could not be 
expected to complete the training successfully. The psychologists 
felt equally certain that the men whose scores for navigator ap- 
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titude or for bombardier aptitude were high were likely to suc- 
ceed as navigators and bombardiers. 

Was this a sound theory? Follow-up studies of thousands of 
men selected on die basis of their aptitude scores on the Aircrew 
Classification Tests demonstrated clearly that die psychologists* 
predictions based on the scores made by those who applied for 
training were good predictions. The practical value of the Air- 
crew Classification Tests to the selection and classification pro- 
gram of the Air Forces and the war effort was obvious. Through 
these tests it was possible to provide the air training schools with 
a continuous flow of cadets who could successfully complete 
their training courses as pilots, navigators, and bombardiers and 
take their places as members of the air crews in America’s 
flying fortresses. 

By the end of the war it was evident that psychological testing 
had paid off. The Air Force had saved millions of dollars in 
equipment and training time, and hundreds of thousands of 
young men were assigned to wartime jobs in which they could 
serve their country best. 

The wartime experiences in testing added to our store of 
knowledge of human talents. We now had a new dimension of 
individual differences — we knew that each person possesses his 
own unique pattern of aptitudes. The fact that one pattern of 
aptitudes made one man a good pilot while quite a different pat- 
tern of aptitudes made his friend a good navigator was an im- 
portant finding. Of even greater importance was the discovery 
that these individual and trait differences in aptitudes persist 
over long periods of time. Intensive training periods and new 
training methods did little to help the person to succeed if his 
aptitudes did not fit the pattern required by the job. 

These facts caused us to abandon the phlogiston-type concept 
of general intelligence and move on to the new concepts tested 
dining World War II. 

What are these new concepts of human ability? What is the 
current view of behavioral scientists regarding the nature of tal- 
ents? There have been many efforts to relate observed patterns 
of intellectual performance to electrical activitv in the brain 
as measured by the electro-encephalograph; to differences in 
speed of conduction of an individual’s nerves; to variations in his 
body chemistry; and to head size or body proportions. None of 
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these efforts has developed a promising relationship with observed 
individual differences* Therefore, in measuring an individual's 
talents at the present time we must rely entirely on his perform- 
ance of sample tasks. Most of these sample tasks will not be new 
to the individual Furthermore, in addition to his natural talent 
for a task, the individual's performance will reflect the extent of 
his training and previous experience with this task, thus compli- 
cating our interpretation of his talents. Although the problem 
of measuring human talents is, therefore, difficult and compli- 
cated at the present time, and the measurements cannot be re- 
garded as precise, they can be useful in assisting the individual 
in identifying the nature of his unique pattern of talents. 

Under present circumstances an individual's talent must be 
defined as his unique pattern of potentials for learning to perform 
various types of activities important in our culture. Such a defini- 
tion includes potential to learn to perform on a musical instru- 
ment, to paint, or to act. But our definition also includes potential 
to learn the more common activities such as preparing food, 
repairing electrical and mechanical devices, cabinet making, 
designing, telling stories, taking part in athletic sports, teaching, 
and administering and managing. 

Present evidence suggests that individuals whose performance 
is high with respect to one aptitude also tend to excel in others. 
However, there are many notable exceptions of individuals hav- 
ing outstanding talent (potential to learn) in one field and below 
average potential in most other fields. To repeat, talent repre- 
sents only potential ability to learn and must be developed. 
There are an infinite number of patterns and combinations of 
talents present in our young people, and it is important that 
each Individual be assisted in identifying his unique pattern of 
talents* 

What do we mean by a pattern of aptitudes and abilities? For 
John, Mary, or Willis, such a pattern might consist in part of 
(1) high ability to understand typical paragraphs of reading 
material; (2) poor performance on the various tests of English 
expression, such as punctuation, capitalization, English usage; 
(3) slowness in checking clerical materials and in arithmetic 
computation; (4) relatively good performance on arithmetic 
reasoning, but only average ability to handle typical secondary 
school mathematics problems; (5) little insight into mechanical 
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relations, and (6) poor ability to visualize movements in two or 
three dimensions, 

We might place beside such indicators of talent other factors 
from personal and family background: (1) a home in which 
there are many books; ( 2 ) a father who completed only one year 
of college, who earns a relatively high wage; (3) a family with 
high aspiration for tlieir sons, but with the straightforward goal 
of early marriage for their daughters. 

How many of the groups of students having this pattern of 
ability (or any one of a thousand different combinations) will 
go to college, and in what occupations will they be successful? 
What personal factors, such as parental influence or early mar- 
riage, will help or hinder these young people in developing their 
talents and using them most effectively? 

To some extent, we can now identify the combination of apti- 
tudes and abilities which are necessary to do well in a liberal arts 
college course. Similarly, the combination required for success 
in an engineering course has been fairly well established. How- 
ever, for many important occupations the requirements for suc- 
cess have been only vaguely outlined. 

The Air Force research, and the concepts that grew out of it, 
showed that we could identify and nut to use with precision the 
talents needed for three wartime tasks of crucial importance. 
Now we need to identify a vastly broader range of talents crucial 
to the peacetime economy and to national technological and 
cultural progress. 

To achieve this, it is necessary to have an adequate setting for 
carrying on research — a setting in which large numbers of 
people can be observed for long periods of time. Anything less 
will not do — as one postwar experience has already proved. 
Shortly after demobilization, the Air Force psychologists at- 
tempted to develop aptitude classification test batteries for peace- 
time jobs. The tests were given to high school students* These 
students were then followed up after they had entered college 
or had gone into various occupations. But the results were not 
conclusive. The numbers were small as compared with the hun- 
dreds of thousands of cadets whose records were readily avail- 
able and who were relatively easy to follow into their careers as 
pilots, navigators, and bombardiers. By contrast, the widely scat- 
tered high school students in the peacetime studies moved from 
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city to city, entered many different colleges and universities, and 
many hundreds of different occupations. The number of young 
people entering any one career was too small to provide the 
basis for good predictions of what makes for success or failure 
in that particular occupation. 

Consequently, fifteen years after the war very few of the 
many hundreds of careers open to high school students had been 
adequately studied to identify with confidence the patterns of 
aptitudes required for success. 

As we shall see in the next chapter, the design for Project 
TALENT calls for studying nearly half a million young people 
and for follow-up studies regarding their education and careers 
stretching into the 1980's. Such a design, we believe, should 
provide us with sharper definitions of talent than we have ever 
had before — in war or in peace. 



4 

How can talent be developed? 

In the United States we maintain not one but several agencies 
for the development of talent. Industry with its on-the-job train- 
ing and apprentice programs; the armed services and their far- 
reaching training activities; adult education, carried on through 
formal classes as well as informal arrangements such as public 
libraries — these are educational agencies of no small import. 
But it is the public and private schools and colleges to which 
Americans look first for the development of talent in their youth. 

To the public schools we have assigned, at least in principle, 
no less a goal than helping each child and youth to realize his 
potential. Here is a goal staggering in its implications. The stated 
ideal is to leave no one without the benefits of education; io de- 
prive no one of the opportunity to become the kind of happy and 
productive person he is capable of becoming. Even though few 
assert that we are within reach of this objective, the peoples faith 
in public education continues to be strong. 

America's devotion to the public schools can be measured by 
two criteria: the support we provide for them; and our readiness 
to engage in controversy about their aims und practices. Al- 
though many observers insist, with justification, that more money 
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must bo assigned for public education, we cannot overlook the 
fact that during 1960, elementary and secondary schools received 
$16.5 billion. This contrasts with only $6.5 billion just ten years 
earlier, in 1950. This increase of more than 1503? can be com- 
pared with an enrollment increase of 45%. Perhaps it is this bite 
into the taxpayer's dollar that leads citizens to make many de- 
mands upon the schools and to criticizo them vigorously, and 
sometimes irresponsibly, when they think their children are not 
getting full benefit from the tax dollars paid for education. 

The public schools have been the center of controversy, raging 
with various degrees of intensity, for more than 100 years. In 
our time, the secondary school bears the brunt of unprecedented 
attacks. Certain academicians assert that basic skills and “hard" 
subject matter content are being neglected, especially in the 
training of the superior student. They maintain that in the 
effort to educate everybody, secondary schools ate sacrificing 
academic standards. Academicians also argue that the second- 
ary schools spend too much time on courses in driver education, 
courses in personal grooming, and extra-curricular activities. 
They decry what they claim to be a leveling down of opportuni- 
ties for the superior mind in favor of turning out ‘life-adjusted 
whole children in a common mold." One of their major demands 
is that the secondary school teachers must have a firmer ground- 
ing in subject matter, even if this has to be done at the expense 
of courses in educational methods. 

In reply, the teachers, school administrators {and professors 
of education! ) charge that the academicians would ignore every- 
thing but the talents of the college-bound student. They insist 
that the secondary school program must be suited to all of the 
types of students enrolled. Secondary education, they assert, 
must be flexible if the needs of all students are to be met. Never- 
theless, sensitive to the academicians' objectives, school officials 
keep revising and reconstructing the curriculum. 

Whether the charges and counter-charges advance the cause 
of education is doubtful. Equally uncertain is whether “crash” 
efforts in subject-matter revision, or even carefully planned cur- 
riculum innovations, will raise the quality of education. For 
example, secondary schools are experimenting with two ap- 
proaches to the “new mathematics," Do these represent an 
improvement over traditional methods? Schools are also intro- 
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duclng changes in physics, foreign languages, and English. Are 
these merely changes or do they represent sound educational 
progress? Such questions arc of vital importance to school ad- 
ministrators and to the public, Mere innovations can be differen- 
tiated from real improvements only if the results tiro evaluated 
over a period of time, 

The academicians defend their subject matter areas in a loud 
and firm voice. No less loud and firm arc the voices of those who 
advocate more and better guidance for children. Much is claimed 
for guidance, Its advocates insist that if every school were staffed 
with “an adequate number of well-trained guidance counselors 0 
(though criteria for determining quantity or quality arc lacking) 
wo would have less juvenile delinquency, better adjusted chil- 
dren, more intelligent career and scholastic choices, and so on. 
But to what extent do school guidance activities make a differ- 
ence in the lives of young people? From where do the influences 
which shape the lives and careers of young people really come — 
from classroom teachers, counselors, parents, or the neighbors 
next door? We do not have the facts to answer such questions. 
Nor do counselors have scientifically devised tools to appraise 
vocational fitness. Batteries of tests for some few specific occu- 
pations do exist. Some are adequate, some are not. But taken 
together, these do not begin to cover the occupations found in 
American industry, business, and the professions. 

Speakers in state legislatures and at school board meetings 
frequently demand the abolition of small schools on the assump- 
tion that “the larger the school, the better its education.” How 
do they know? Such speakers rely on thn arguments of partisans 
rather than on the evidc ::e of investigators. We still don't have 
facts that would answer with precision what effect the size of 
the school has on the effectiveness of education. Nor do we 
have evidence to answer a host of other questions. Take these 
two: To what extent would an increase in appropriations for 
instruction result in an increase in teaching quality? And, what 
is the effect of home background and parent occupation on a 
child’s learning? 

Although the air in the educational community is thick with 
expressions of opinion, only rarely is objective proof available 
to show that one practice is better than another; one policy more 
productive than a second. 
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Research studies, designed to make the schools more effective, 
are under way In many graduate schools and are being spon- 
sored here and there by professional or special-interest groups, 
But much research in education is limited to surface problems 
and too few cases, Research also suffers from short-span in- 
quiries. 

No single research effort, regardless of scope or duration, can 
provide all, or even a substantial part, of the information needed 
for the development of talent in a country as large as ours. With- 
out anticipating what is to follow, we can say now that Project 
TALENT involves the largest number of school children ever 
to take part in a research study — and that they will be involved 
for more than two decades — thus providing the vast dimensions 
required for an investigation of such complex problems. 



5 

How can an individual make the best use of his talents? 

What does it avail a person if he has a unique pattern of apti- 
tudes and if these are developed — if lie doesn’t use them? Use 
of talent is a test of talent Production is the pay-off. But what 
forces release our productivity? And how can the levels of pro- 
ductivity be raised so that what we do is more than ordinaiy 
or routine, and reaches the quality of creativeness and brings us 
lasting satisfactions? 

Now we are at the last of the three underlying questions about 
talent — that is, how can the individual best use his talents? 
Enough research has been done to suggest that there exist forces 
within us and outside us that can operate on our will to per- 
form and increase our power to create. The research literature 
on motivation, productivity, and creativity is growing. We shall 
have occasion to refer to it — in later reports coming from Proj- 
ect TALENT, Some of it is significant and revealing. 

For the moment, it will be more revealing to become ac- 
quainted with a high school student we shall call Robert. Rob- 
ert is one of nearly 440,000 students taking part in our research 
activities. We are not using his real name so we can tell you 
freely a good deal about him. 

When Robert took the Project TALENT tests, he was 16 years 
old and at the end of his junior year in high school. He reported 
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that he gets up at 5 o’clock every morning to deliver papers. With 
this and other jobs, he works about 16 to 20 hours a week, earn- 
ing all his spending money. When he gets home after school, 
lie puts in some time on chores, amounting to about 10 hours 
a week. Athletics take up 12 hours a week. He also spends part 
of his spare time building and repairing electrical and electronic 
apparatus. 

He has had four semester courses in science, two in a foreign 
language, six in social studies, six in English, and six in mathe- 
matics. His grades in mathematics have been mostly C*s and D’s, 
while his grades in other subjects have been mostly B's and C’s. 
He spends only one to four hours per week on his homework. 
It appears to be crowded out by other activities and interests 
(26 to 30 hours of work and 12 hours of athletics each week). 

Robert says he likes to hunt, swim, and explore. He does not 
like to read novels, but he enjoys science fiction and technical 
books. He states that he would like to work at a government 
rocket proving ground because he likes working with electricity 
a»:d electronics. 

We have additional facts about Robert which only a battery of 
aptitude tests similar to that of Project TALENT could reveal. 
(Figure 1 shows the profile of his test scores.) He had a perfect 
score on our aeronautics and space information test. He had 
exceptionally high scores on tests which measured his accumula- 
tion of facts on physical sciences and mechanics, his ability to 
visualize in two dimensions, and his creativity. These high scores 
suggest that Robert has considerable aptitude in the general field 
of science. He has probably acquired information about science 
and mechanics cutside the classroom — just as he has confirmed 
his strong interests in science through spare time tinkering and 
science-fiction reading. 

Our tests also spotlighted an almost hidden fact about Robert. 
He made a very good score on a math information test, showing 
that he has considerable general knowledge about mathematics 
even though his performance in school math work has been be- 
low average, as shown by his G and D grades. On the Project 
TALENT math achievement test his score exceeded those of 78 
per cent of the high school juniors in the study — not outstand- 
ing, but better than his grades would suggest. 

Robert's English test scores were very low. Since a passing 
grade in English is still one of the requirements for admission 
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FIGURE 1 
Robert’s Profile Chart 
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to colleges and engineering schools, he does not, to the traditional- 
minded teacher, look like good college material. What are 
Roberts college plans? He reported to Project TALENT that 
he might not go to college, although he would like to. He may 
have to borrow money to do so. If he is able to raise the money, 
he would like to major in physical science. 
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Such arc the facts Project TALENT obtained about Robert. 
IIow can Robert’s school and parents use these facts to help him 
make tho best use of his talents? 

Teachers could do much to assist in developing Robert’s con- 
siderable talents in science If they gained an appreciation of tho 
nature of these talents. Once they gain this appreciation (in 
this instance, from tho test scores), they can direct Robert to 
further education in the physical sciences, since that is what 
his interests and aptitudes point to. But low math and 
English grades stand in the way. His teachers, therefore, should 
try to point out to him the relation of better achievement in 
math and English, his poor subjects, to physical sciences, his 
main interest. This encouragement may motivate Robert to study 
math and English harder. Motivation for Robert can also op- 
erate in another way. It is quite possible that the pull of his 
strong interest in the field of electronics may, itself, induce him 
to work harder on math and English — that is, if he sees the 
relationship between these subjects and the job he wants in the 
future. 

Witliin a year after his graduation from high school, we shall 
know more about what happened to Robert. We shall ask him 
to give us facts about his post high school experiences. We shall 
know whether he has, in fact, enrolled in a college and has 
chosen the physical sciences as his major interest. Within Eve 
years we shall know what kind of employment he has accepted; 
within ten years we shall know much about his success; and 
within twenty years we "hall know even more about the way in 
which Robert has used his talents. 

Throughout our follow-up of Robert, we shall try to determine 
how he has utilized his latent talents in the physical sciences; we 
shall try to identify the educational and occupational experiences 
which may have encouraged or discouraged his productivity or 
his creativity. If he is relatively \mproductive, we shall try to 
find the reasons. If, on the other hand, he becomes a highly 
productive, perhaps creative, person, gaining recognition as sci- 
entist or inventor, we shall learn from Robert’s record — along 
with the records of thousands of other students — facts that will 
help Martha, Peter, and John toward greater productivity and 
creativity. 




A Design 
for Investigation 



Research — “pure” and u applied ” — has provided 
modern man with the means for unlocking nature's 
secrets and for placing new power in his hands . In 
this chapter we describe the factors essential to good 
research and the way ip which research methods can 
be applied to the problems of developing human 
ability. 

We then describe how the research was designed to 
provide facts to help in bringing about more effective 
use of talents in scores of occupations , We list some 
questions about the American high school which re- 
quire answers . These questions deal primarily with 
the ways the American secondary school can improve 
its service to youth — both in the classroom and in the 
counselors office. 



T 

I he year was 1959. In a conference room in the nation's capi- 
tal, a group of men sat quietly making pians, the final out- 
come of which would not be felt until 1980. While the headlines 
shouted threats of atomic war, atmospheric pollution, and Big 
Brother dictatorship, this group with a more positive and far- 
sighted approach was outlining the procedures for a long-range, 
scientific study of American youth and their schools. 

In the group were educators, psychologists, and sociologists. 
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For nearly two years they had been meeting in other conference 
rooms and other cities in an effort to design the study which 
to us, on the staff of Project TALENT, was pressing and overdue. 
These planning meetings were to continue for nearly another 
year until the blueprint for research procedures was finally 
completed. 



2 

If there is a single label to describe the particular educators, 
psychologists, sociologists and others engaged in this work, the 
story of which we’re about to trace, that label is behavioral scien- 
tist . As such, they were hard-headed men. And, though they 
had different interests and backgrounds, they all had been trained 
in the toughest of all disciplines — the discipline of scientific 
research. 

Scientific research has been defined in many ways — but one 
thing it is not: it is not burrowing in a library, reading yellowed 
tomes, or recording the opinions of authorities. Legitimately, 
however, the term has been stretched to cover many phases of 
man’s inquisitive and inventive activities. There is research in 
the natural sciences and in the social sciences; there is basic and 
applied research. Drawing on the results of basic research, in- 
dustry spends four cents out of every dollar for applied research 
and for the development of inventive ideas into products. Gov- 
ernment, the military, medicine, aviation, forestry — all invest 
heavily in research. Many observers complain that executives 
and officials tend to favor 'practical” research over ''basic” re- 
search. There is some justification for the complaint. We don’t 
always recognize that the man who thinks must come before the 
man who turns that thinking into a product 

Research, fundamentally, is a way of thinking — and out of 
it come new theories, new knowledge, new products — all 
equally important. It is thinking based on the observation of 
many facts. This does not exclude dreaming or formulating 
hunches. Imagination and hypotheses are important ingredients 
of research. But above all, the researcher calls for evidence. Ob- 
servations give us the first approximation to knowledge. The 
scientist’s way of looking and observing must differ from that of 
the poet — and this without disparaging the latter. 
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The scientist uses tools to increase the precision of his observa- 
tions. For the natural scientist such devices may include the 
microscope or chemical analysis. For the social scientist, they 
may include interviews, records of experience, test scores, and 
coefficients of correlation. 

As the researcher observes the facts, he records them, classifies 
them, and sifts the important from the unimportant. Even while 
he is engaged in these preliminary steps, his mind is already 
trying to understand what the facts imply — for facts, in them- 
selves, have little value for the researcher or for man in general. 
Only as facts are analyzed and as generalizations are drawn from 
them which give us new insights into nature’s ways does the 
researcher feel rewarded. It is here that the researcher faces the 
most difficult part of his task. This is the phase that demands 
logical thinking. Reasoning must be applied — reasoning that 
originates with the observation of particular facts and goes on to 
a generalization; the thinking frequently involves a shrewd guess 
— then a return to the facts to search for support or rejection of 
that guess. 

Fact-gathering, fact-analysis, fact-interpretation — these are the 
trinity of research. 

The process and machinery of both basic and applied research 
have become complicated and mechanized. This has tended to 
obscure the fact that the underlying force of research is intel- 
lectual power. Research begins in the mind. It is the puzzled 
mind, the curious mind, and the concerned mind which impel 
men to reach for new knowledge and to seek solutions to mens 
problems. 



3 

The behavioral scientists who were helping us lay plans for 
research into youth’s potentialities shared our deep concern over 
the waste of human abilities, the efficiency of America’s educa- 
tion in developing these abilities, and their later utilization for 
the good of the individual and our country. 

These problems stemmed from life. Their solutions had to 
be sought in life. They could not be found in laboratory settings, 
through using a few cases under short-term observation. This 
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was especially true of the question of first concern to us and 
the scientists with whom we were consulting. This question was: 
How can people make the most of the abilities and aptitudes 
with which they are endowed? 

The aptitude tests developed during World War II had already 
proved it was possible to devise tests that would predict whether 
a man could become a successful pilot, navigator, or bombardier. 
The scores of such tests had provided important clues in assign- 
ing military personnel to training in which they would succeed 
and to jobs in which they would utilize their aptitudes to best 
advantage. If it were possible to do this for a limited number 
of wartime occupations, with considerable savings of military 
manpower, would it not be possible to do it for a larger number 
of civilian occupations? 

We assumed that it would be possible. If so, the subsequent 
conservation of talent would be enormous. Our assumption was 
bolstered by postwar research which had centered on the devel- 
opment of aptitude classification tests for a number of civilian 
occupations. Now we were ready for a bold design which would 
embrace performance in college and in some hundreds of careers 
within many occupational fields. Some of the career fields for 
which partial information was already available are listed in 
Figure 2. 

To develop instruments that would predict a persons perform- 
ance in these, and other careers, was a venture of no small size. 
For success, it would require testing large numbers of youth at 
about the time they were making their first decisions regarding 
their future careers, and then observing them closely for years — 
at least until they reached the peak of their productivity. Boys 
and girls in Grades 9 through 12 clearly provided the best group 
with which to work on this long-range problem; and while we 
knew we could not involve all these students, we were convinced 
that we would require thousands upon thousands of them. 

But we required something more — time. Long periods of 
time. Time in which to observe whether the clues provided by 
the tests in 1960 were really indicative of how successfully people 
would be utilizing their aptitudes and abilities in 1961, 1965,. 
1970, and 1980. The concept of the follow-up was, therefore* 
incorporated into the design of the research. 

We decided to follow up each class of students by mail ap- 



FIGURE 2 



Sor/ic Career Fields for Which Project TALENT Tests May 
Predict Future Performance 



ACCOUNTING 

Auditor, Certified Public Accountant, Comptroller, Cost Accountant, Public Accountant, 
Statistician, Tax Accountant 

ENGINEERING AND PHYSICAL SCIENCES 
Engineer, Physicist, Chemist 



BIOLOGICAL SCIENCES 

Agricultural Biologist, Animal Scientist, Plant Scientist, Parasitologist, Entomologist, 
Hydro-biologist, Biochemist, Biophysicist, Physiologist, Microbiologist 

TEACHING 

Elementary and High School Teachers 

FOREIGN LANGUAGE 

Language Specialist, Interpreter, Linguist, Language Teacher, Foreign News Corre- 
spondent, Translator 

WRITING, JOURNALISM 

Journalist, Reporter, Editor, Author, Public Relations Man, Technical Writer, Ad 
Writer 



ART 

Architect, Advertising Artist, Illustrator, Industrial Designer, Fashion Designer, Fabric 
Designer, Lithographer, Painter, interior Decorator, Engraver 

SECRETARIAL 

Secretary, Stenographer, Typist, Court Reporter 

OFFICE CLERK 

Office Clerks: Accounting, Banking, Billing, Correspondence, Filing, Mail, Payroll, 
Shipping, Statistical, Stock, Receptionist, and others 

MECHANICAL WORK 

Machinist, Tool and Die Maker, Sheet Metal Worker, Molder, Boilermaker, Automobile 
Mechanic, Aircraft Mechanic, Machine Repairman, Engine Mechanic, Patternmaker, 
Welder, Joiner, and others 

ELECTRICAL AND ELECTRONICS 

Electrician, Electronics Mechanic, Field Service Engineer (electronics). Maintenance En- 
gineer (electronics), TV and Radio Repairman, TV and Radio Studio Engineer, Tele- 
graph and Telephone Electrician 



AGRICULTURAL 

Farmer, Forester, Horticulturist, Nurseryman 

AIRPLANE PILOT 

Commercial Pilot, Test Pilot, Instructor Pilot, and others 
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proximately one year after graduation from high school, Thus, 
the 12th grade group would be followed up in the summer 
of 1961; the 11th grade group in 1962; the 10th grade group in 
1963; and the 9th grade group in 1964, We also decided to at- 
tempt follow-ups five, ten, and twenty years after graduation. 

During each of the follow-ups, the individuals will be asked 
many questions, but mainly they will be asked to report on the 
training courses and occupations they actually entered, the rea- 
sons for their choice, and their success and satisfaction with the 
activity they chose. By comparing the replies with the original 
test scores and background data on each student, we will be able 
to tell how well the tests of 1960 predicted success in the careers 
chosen by these young people, If the tests and test scores are 
really effective in predicting success for the activities for which 
they were designed, then, in time, we shall have instruments of 
great potential value for the classification and placement of 
young men and women in tasks which they will ultimately find 
satisfying and productive. 



i 

i 



A century and a half ago the United States originated an edu- f 

cational institution which has; remained unique in the world, f 

It is the American public secondary school. The Boston Latin \ 

Grammar School was the first, and its purpose was to develop ) 

the talents of boys planning to enter the ministry, law, or pos- j 

I sibly merchandising, 3 

Fifteen decades of growth and change have created a vast j 

network of some 26,000 institutions open to every adolescent, 
regardless of sex, race, or economic status. Over the years, the 
\ high school has adopted philosophies, practices, and offerings 



f. appropriate for each generation; some of these have been out- 

grown, in due time, in favor of newer philosophies, practices, 
and offerings. Vestiges of the old have always remained. As 
a result, it is unsafe, today, to generalize about the American 
high school. Many an institution is a mixture of the traditional 
| and the progressive; of the rigidly academic and the practical 

life-adjustment type of curriculum. Some high schools spend as 
little as $140 per pupil; others, more than $300. Some maintain 
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faculties of superbly trained men and women; others are forced 
to employ teachers with substandard certificates. Some are ven- 
turesome, experimenting with new math, Saturday-morning sci- 
ence, teaching teams, and teaching machines. Others are static. 

Within the past generation nearly all high schools have been 
exposed to programs of guidance. Some institutions have estab- 
lished extensive guidance and counseling departments and have 
supported them with ample funds and administrative encourage- 
ment. Other schools have either not been convinced of the value 
of guidance or have not had the means to create a program that 
would effectively reach the lives of their pupils. The result is 
that today American high Lchools provide guidance services 
which range from excellent to poor. Some are intensive, others 
superficial; some are continuous, others hit-or-miss; some are 
staffed by trained men and women, others by overworked class- 
room teachers. 

Despite the great diversity in character and quality of the 
secondary school instruction and guidance, all American high 
schools are pretty much on the same time schedule. Each year 
they accept an entering class of a few students or a few hundred 
students — and four years later, willy-nilly, for better or for 
worse, send about three-fourths of them on either toward post 
high school education or toward jobs. The remaining quarter 
drops out before graduation. 

What effect do the varied and different high school policies 
and practices have on the youth? And, specifically, what effect 
do they have in developing students' innate aptitudes and 
abilities? We decided to undertake to answer at least the follow- 
ing ten questions: 

1. Does the size of a high school make any appreciable differ- 
ence in the development of youth’s talents? 

2 . Is a high school which spends more money for each of its 
pupils more efficient in developing men and women who are 
successful in applying and utilizing their aptitudes? 

3. Are small classes more effective than large classes? 

4. Is the graduate from a high school with a traditional cur- 
riculum more likely to succeed in college than one from a high 
school with an “activity” curriculum? 

5. Does strict discipline within a school have any effect in 
reducing delinquency and crime rate among its graduates? 
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6. What factors and forces within a high school operate to 
hold its pupils until graduation? Conversely, what operates to 
pull students out before graduation? 

7. What is the exact nature of a guidance program which 
has a deep and lasting effect upon youth in their choice of 
educational or occupational careen? 

8. Which of die many curricular innovations attempted in sec- 
ondary schools contribute most effectively to success in college 
work or in paid employment? 

9. What effect does the parent’s occupation and home back- 
ground have upon the acquisition of knowledge and develop- 
ment of aptitudes among the young? 

10. What is the exact nature of an educational guidance pro- 
gram which helps the student solve his personal problems effec- 
tively and develop sound habits, plans, and goals? 

These are some of the major questions about schools which we 
proposed that our research answer. At the same time, we took 
core to design the study so that a multitvide of additional ques- 
tions could be answered with a precision heretofore impossible. 

The gains from a broad evaluation of patterns of aptitudes and 
abilities will benefit future students. Ten and twenty years from 
now, young people will be able to study the experiences of thou- 
sands of students who left high school between 1960 and 1963 
with combinations of aptitudes and abilities similar to their own. 
They will be able to plan much more wisely for the full develop- 
ment and use of their potential aptitudes and abilities. And the 
high school of a decade or two hence will also have a body of 
facts to suggest how educational and guidance programs might 
be changed to cut the waste of potential talent. 



5 

Facts. Facts. Facts. Every part of the design for the research 
called for an unprecedented volume of information about stu- 
dents and their schools. As it turned out, we laid plans to collect 
about 2,000 items of information about each student and 1,000 
items of information about each school. Such a vast amount of 
data, we hoped, would satisfy the research needs not only of 
Project TALENT, but also of many other researchers. It became 
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part of our design, therefore, to develop a storehouse of facts 
for the use of investigators seeking solutions to other pressing 
educational and manpower problems. 

How we gathered these facts, what they cover, how we shall 
analyze them, and finally, how they will be utilized for the bene- 
fit of youth, schools, and the country is the rest of our story. 




Selecting the 



Students and the Schools 



A school in Eastern Kentucky, another in the Bronx, 
and another in Washington, D.C., were among the 
1,353 schools taking part in our study. Here we tell 
how we chose the schools and how we chose the stu- 
dents within the schools for participation in our re- 
search. 

We describe the scientific way of choosing a random 
sample of schools and pupils to make sure that all 
parts of the United States and all sizes and types of 
schools are fairly represented. We show the number 
of public, private, and parochial schools taking part 
in our research, and indicate the states in which they 
are located . 



l here is a school in the mountains of Eastern Kentucky which 
can be reached only by a gravel road bounded on either side 
by steep hills heavily wooded with pine, Occasionally the woods 
open sufficiently to reveal a cabin with an out-building, then the 
trees close in again, the steep slopes silently hostile to attempts 
to use the land for a livelihood. At a sharp fork in the road, 
one turns to the light and the road dribbler out and is no more. 
A wide shallow brook outlines the foot of the hill directly ahead. 
Across the brook are a school and accompanying dormitories. 
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The dormitories are necessary, for the isolated and rugged coun- 
try makes daily trips to and from school impossible. This is the 
Red Bird Settlement School. 

At the corner of West 205th Street and Golden Avenue in the 
Bronx, New York City, students gather from all over the city 
to study calculus and advanced courses in science. A high pro- 
portion of them will eventually earn doctoral degrees and assume 
key positions in science. This is the Bronx High School of Sci- 
ence. 

Off a residents street in Washington, D.C., a driveway sweeps 
into a broad arc up a hill in front of the main enhance of a 
modem parochial secondary school. The structure is of con- 
temporary brick-and-glass design. The school appears to convey 
an impression of a quiet and efficient atmosphere. Students 
move from room to room with a bearing which seems to reflect 
their pride in the physical plant itself. This is the Archbishop 
Carroll High School. 

About the middle of November, 1959, the superintendents 
responsible for these three schools opened their mail and read 
a letter inviting them to participate in Project TALENT. Almost 
a thousand other superintendents received a similar letter at about 
the same time. 

How were the Red Bird Settlement High School, Bronx High 
School of Science, Archbishop Carroll High School and the other 
high schools selected for an invitation to join in the project? 
Who made the decisions, and on what basis? Furthermore, why 
were not all high schools in the United States invited to take 
part? 

To answer the last question first, only rarely is a research study 
based on information gathered from 100 per cent of the indi- 
viduals in a group. Most surveys carried out by the Bureau of the 
Census, Bureau of Labor Statistics, or Department of Agricul- 
ture select only a part of a group to study — sometimes a very 
small part. In business and industry, too, decisions as to whether 
a product meets the standard are usually based on inspection of 
a small proportion of the total output. 

Similarly, Project TALENT could not involve all the millions 
of students enrolled in America’s public and private secondary 
schools. Nor would that be necessary. It was necessary, how- 
ever, to select a segment of the high school population sufficiently 
ample in number and so typical in char acter that we could say — 
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this portion truly represents the whole. To put it differently, we 
had to select an adequate and representative sample. To select 
such a sample, sound methodology is all-important. Nothing 
could be left to chance — and somewhat paradoxically, this 
meant that the final choice had to be left to chance. If this re- 
mark seems enigmatic, we hope later parts of the chapter will 
clear up the enigma. 



2 

We decided that a sample involving five per cent of the high 
school enrollment, or between 400,000 and 500,000 students, 
would be large enough to provide a sturdy base for our con-' 
templated research structure. Such a sample had the dimen- 
sions to satisfy many research needs of the present and future. 
For one thing, we knew that we would be studying many dif- 
ferent groupings and sub-groupings of individuals and schools. 
To do this adequately, the initial size of the sample had to 
be large enough so that it could be divided, subdivided, then 
divided again and still yield substantial information. Later, as 
follow-up studies progressed, the original facts collected would 
be broken down for students who did and did not go to college; 
for those who did and did not finish college; for students who 
trained for many different profession* and occupations; for those 
who succeeded and those who failed in their chosen field; for 
those who achieved high standing and renown — and, at the 
other end of the scale, for those who ran into trouble with society. 

But there is still another reason the sample needed to be so 
large. We knew that a good percentage of this number would 
go into clerical jobs, sales work, mechanics; a smaller percentage 
would become lawyers, doctors, nurses, and teachers. But few 
indeed would become nuclear physicists, research chemists, or 
theoretical mathematicians. Yet, we would want to trace the 
factors in the career development of these future high-level spe- 
cialists. Out of a half million students, probably no more than 
2,000 would become Ph.D.'s; of these there might be 100 mathe- 
maticians and 200 physicists. A large sample would be necessary 
if we were to draw these future specialists into our study. 

Another question that had to be settled was whether to choose 
the sample on the basis of school systems, separate schools, or 
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individual students. In many of the studies to be carried out 
with Project TALENT data, the schools would be the focus of 
concern. Student achievement and future success would be 
studied in relation to large and small schools, public and private 
schools, conventional and experimental curricula, and so on. For 
this reason — as well as for the sake of administrative efficiency 
— wc established the school as the sampling unit. 

How many schools would wc need in order to draw a sample 
consisting of five per cent of high school students? Five per 
cent of the schools? Theoretically, yes — and, as it turned out, 
we did give the tests in approximately one out of every twenty 
schools. But it wasn’t as simple as that. 

The sizes of public high schools differ radically — from less 
than a hundred students to more than 5,000. The small high 
schools dotting the rural countryside are far more numerous 
than very large city high schools. To emphasize the contrast, 
the total enrollment of several dozen rural schools may fall far 
below the enrollment of one city school. To select one out of every 
20 schools in the country without consideration of size differences 
would have resulted in so few large public high schools — and 
so very many small schools — that our later research on the ef- 
fects of school size would have been inconclusive. The solution 
was to invite one out of every 20 medium-sized public high 
schools to participate in the study; one out of every 13 very large 
schools; and one out of 50 small schools. We invited one out of 
20 private and parochial schools, regardless of size, to participate 
in Project TALENT, 

To adjust for these variations, our statistical procedures called 
for “weighting” the schools in the analysis of the data obtained 
from them. Only by applying appropriate weights to the data 
can results be obtained which permit sound inferences about the 
total population of high schools or high school students. 
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The decisions made so far controlled the dimensions of the 
sample to be selected, but they did not control exactly which 
schools were to be included. 

From various sources, primarily the U.S, Office of Education, 
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we had obtained the names and addresses of all high schools in 
the United States — some 26,000 schools — along with their en- 
rollment figures. It was from these official sources that we had 
to select approximately one out of every 20 schools. But which 
ones? We were face to face with the sampling problem. 

In order to avoid biases, it is necessary to select the sample 
in a random manner. A characteristic of a simple random sample 
is that every member of an entire gro>'p has an equal chance of 
being in the sample. The laws of chance operate in such a way 
that a random sample will tend to be representative in all 
respects of the group as a whole. 

Random sampling can be improved by a procedure known as 
stratified random sampling. This consists in dividing the entire 
group into smaller groups, according to one or more characteris- 
tics, and then using a strictly random selection method within 
each classification. To classify, or “stratify," the total group ac- 
cording to certain characteristics before drawing the random 
sample makes it more representative in certain respects and less 
representative in none. In view of this admirable feature, strati- 
fied random sampling was the method used in selecting schools 
to participate in Project TALENT. 

There is a limit, of course, to the number of characteristics 
that can be singled out for such special handling, even in a sur- 
vey as comprehensive as Project TALENT. We wanted to select 
only the most important characteristics and through stratifying, 
take out insurance, so to speak, that the sample would be truly 
representative in regard to these characteristics. 

The first important characteristic to be singled out was an 
obvious one involving the type of school — public, parochial, or 
private. In our groupings we included all Roman Catholic high 
schools in the parochial classification. Other church-affiliated 
schools were put in the private school group. 

We also wanted to be certain that we would have proper geo- 
graphical representation. There is a big difference in schools 
because of differences in the economy of the region and the nature 
of the population. There are also differences in schools because 
the various state departments of education set different require- 
ments for curricula, teacher certification, and graduation. Still 
another significant factor is whether the school is in a very large 
city or a relatively small community. For these reasons, we first 
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grouped schools into broad geographical areas and then sub- 
grouped them by states, our basic geographic unit. Five cities, 
because of their large size, were also considered as basic geo- 
graphic units. These were New York, Chicago, Los Angeles, 
Philadelphia, and Detroit. Such treatment assured us of having 
proper large city representation. The map in Figure 3 illustrates 
the geographical distribution of schools selected to participate in 
the project. Table 1 shows the number of schools included in 
each geographical unit. 

We next took steps to insure that the sample would reflect 
the differences in school size. Size is certainly one of the most 
important variables among schools. For one thing, a small school 
cannot offer as varied a curriculum as a large school except at 
greater cost per pupil. We therefore divided the public high 
schools intn the following four groups according to Grade 12 
enrollment: (1) those with less than 25 seniors; (2) those with 
25-99 seniors; (3) those with 100-399 seniors; (4) those with 
400 or more seniors. One reason for this particular division was 
to set up two groups that would, and two that would not, meet 
the minimum size standards for schools recommended by edu- 
cational authorities. 

Another characteristic singled out for special attention among 
public high schools was the student holding power of the schools. 
In some schools many students drop out before graduation; in 
others nearly all stay to graduate. Since we assume that there 
are major differences between schools with high and low 
holding power, we wanted to be sure we had proper repre- 
sentation of each type. This stratification was made by computing 
a retention ratio for each school. The ratio was the number of 
students who graduated in 1958 to the number of students in 
the 10th grade in 1959. This information provided a separation 
of schools into categories on the basis of whether (at one end 
of the scale) nearly all students graduate, or whether (at the 
other extreme) very few students graduate. 

The machine that did the actual selection work (IBM-650) 
was given considerable human prompting on how to make a 
random choice from each category. For instance, the machine 
was instructed to take into account the different sampling ratios 
that had been set up for schools of different sizes. Instead of 
picking one in 20 as for medium-sized schools, the machine was 
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The National Sample of Schools 
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programmed to pick out one out of 13 very large schools and 
one out of 50 very small schools. 

Parochial and private schools were stratified (separately) into 
the 56 geographical units, but there were too few of these non- 
public schools to make it desirable to stratify them on school 
size and holding power, too. 

The ninth-grader was, of course, an important individual in 
our study. But America’s public secondary school organization 
sometimes places the ninth-grader in a four-year public high 
school and sometimes in a three-year junior high school. Not all 
graduates of a particular junior high school go to a particular 
senior high school, and not all tenth-graders in a senior high 
school come from the same junior high school. This gave rise 
to complications in obtaining a representative sample of ninth 
graders. However, a solution to the problem was found. Where 
junior high schools or groups of junior high schools were clearly 
and unambiguously associated with a senior high school that 
had been selected, the ninth-graders in those junior high schools 
were put in the sample. In communities where the situation was 
not so clear cut, the coordinators helped in deciding what junior 
high schools would include the maximum number of ninth-grade 
students who would go to the selected high school and the mini- 
mum number who would go to any other senior high school. A 
small supplementary sampling of the remaining junior high 
schools, together with a procedure for adjusting school weights, 
provided the means for mathematically correcting any minor 
inaccuracies that might have resulted from the approximation 
procedure described above for selecting the junior high schools. 

One important phase of Project TALENT was to collect in- 
formation on an entire age group, the 15-year-olds. This meant 
that the data had to be obtained not only for the 15-year-olds 
in high schools, but also for 15-year-olds still in Grade 8 or below, 
already in college, or not in school at all. We decided that the 
non-high-school 15-year-olds to be included in the study were 
to be residents of areas served by one-tenth of the public senior 
high schools selected in the sample. The schools selected in the 
sampling phase were divided into ten sub-samples which would 
be as close to equivalent in terms of the stratification variables 
as could reasonably be achieved. One of these ten sub-samples 
(designated “Sub-sample 0”) was then selected to include the 
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non-high-school 15-year-olds for study. These non-high-sohool 
15-year-olds are not intended to be considered part of the regular 
sample, which consists entirely of high school students. How- 
ever, they will supplement the 15-year-olds in the regular sample 
to provide a picture of the entire age group — the total group 
of 15-year-old Americans. 

Two other special groups require mention at this point. The 
first consisted of two small groups of schools trying experimental 
courses in mathematics. The two experimental programs were 
developed by Dr. Max Beberman of the University of Illinois and 
Dr. E. G. Begle, formerly of Yale University. The performance 
of students in this new type of program will be compared with 
that of matched groups of students who take conventional mathe- 
matics courses. 

Another special group are the schools in Knoxville, Tennessee, 
and in the surrounding county, Knox County. Two schools were 
drawn as part of the regular sample in this area, but as a result 
of the special interest of the school authorities there it was pos- 
sible to arrange to test every student in every school — public, 
parochial, and private — in the entire Knoxville and Knox County 
area, not only in Grades 9 through 12, but also in Grade 8. This 
very comprehensive testing in a concentrated area, over a five- 
grade range, will make possible many special studies that could 
not otherwise be carried out. 



4 

Much of the thought, time and effort that went into building 
the invitation list for Project TALENT would have been in vain 
if the schools had declined to take part. Our uncertainty on this 
score was short-lived, When the replies started coming in, they 
were nearly all in the affirmative. In all, 93% of the schools se- 
lected in the sampling process agreed to participate — a sur- 
prisingly high percentage in view of the magnitude of the under- 
taking to which the schools were committing themselves. Table 1 
shows the number of schools selected in each part of the coun- 
try, and the per cent of those which agreed to participate in the 
project. It should be noted that this table represents only the 
senior high schools selected in the sampling process. It does not 
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TABLE 1 

School Participation in Project TALENT 

The number of schools invited and actually participating by geographical units and type of school 



Geographical Public Senior Parochial Private All Groups Percent of 

Units High Schools High Schools High Schools Combined Schools Par - 

PARTICIPATING , Yes No Total Yes No Total Yes No Total Yes No Total ticipating 



2. New England 


. . 33 


— 


33 


13 


— 


13 


9 


_ 


9 


55 


_ 


55 


100.0 


Maine 


6 


- 


6 


j 


_ 


1 


2 


— 


2 


9 


_ 


9 


100.0 


New Hampshire 


3 


- 


3 


1 


- 


1 


1 


- 


1 


5 


_ 


5 


100.0 


ox Vermont 


3 


- 


3 


1 


- 


1 


1 


- 


1 


5 


- 


5 


100.0 


Massachusetts 


14 


- 


14 


8 


— 


8 


3 




3 


25 


_ 


25 


100.0 


Rhode Island 


2 


- 


2 


- 


- 


- 


- 


_ 


- 


2 


- 


2 


100.0 


Connecticut 


5 


- 


5 


2 


- 


2 


2 


- 


2 


9 


- 


9 


100.0 


2. Mid-east 


.. 168 


8 


176 


26 


5 


31 


10 


3 


13 


204 


16 


220 


92.7 


New York City 
New York ( except 


85 


— 


85 


3 


1 


4 


2 


— 


2 


90 


1 


91 


98.9 


New York City) 


27 


4 


31 


9 


- 


9 


3 


- 


3 


39 


4 


43 


90.7 


New Jersey 


7 


4 


11 


4 


— 


4 


2 


- 


2 


13 


4 


17 


76.5 


Philadelphia 
Pennsylvania (except 


2 


- 


2 


— 


2 


2 


— 


1 


1 


2 


3 


5 


40.0 


Philadelphia ) 


38 


- 


38 


6 


2 


8 


2 


1 


3 


46 


3 


49 


93.9 


Delaware 


2 


- 


2 


— 


_ 


- 


- 


- 


- 


2 


- 


2 


100.0 


Maryland 


7 


- 


7 


4 


- 


4 


1 


- 


1 


12 


- 


12 


100.0 


Dist. of Columbia 


“ 


“ 


— 


— 


— 


- 


“ 


1 


1 


— 


1 


1 


0.0 













— 
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Q. Great Lakes 




5 


105 


25 


2 


27 


7 


1 


8 


102 


8 


200 


96*0 


Ohio 


41 


1 


42 


0 


_ 


6 


1 


— 


1 


48 


1 


49 


98.0 


Indiana 


26 


— 


20 


2 


_ 


2 


_ 


- 


— 


28 


- 


23 


100.0 


Chicago 
Illinois (except 


20 


— 


20 


1 


2 


3 


1 


“ 


1 


22 


2 


24 


01.7 


Chicago ) 


31 


1 


32 


4 


- 


4 


2 


- 


2 


37 


1 


38 


97.4 


Detroit 

Michigan (except 


1 


— 


1. 


3 • 


— 


3 


- 


- 


“ 


4 


- 


4 


100.0 


Detroit ) 


22 


3 


25 


<3 


- 


6 


2 


1 


3 


30 


4 


34 


88 . 2 


Wisconsin 


19 


- 


19 


3 


- 


3 


1 


- 


1 


23 


- 


23 


100.0 


4, Plains 


.. 112 


6 


118 


16 


_ 


10 


5 


_ 


5 


133 


6 


139 


95.7 


Minnesota 


20 


- 


20 


3 


- 


3 


2 


- 


2 


25 


- 


25 


100.0 


Iowa 


21 


1 


22 


5 


- 


5 


- 


- 


- 


26 


1 


27 


96.3 


Missouri 


23 


1 


27 


3 


- 


3 


1 


- 


1 


30 


1 


31 


96.8 


North Dakota 


7 


1 


8 


- 


- 


- 


- 


- 


- 


7 


1 


8 


87.5 


South Dakota 


9 


1 


10 


1 


- 


1 


1 


- 


1 


11 


1 


12 


91.7 


Nebraska 


15 


_ 


15 


2 


- 


2 


- 


- 


- 


17 


- 


17 


100.0 


Kansas 


14 


2 


16 


2 


- 


2 


1 


- 


1 


17 


2 


19 


89.5 


5. Southeast 


. .. 216 


14 


230 


13 


3 


16 


8 


4 


12 


237 


21 


258 


91.9 


Virginia 


14 


2 


10 


1 


- 


1 


1 


1 


2 


10 


3 


19 


84.2 


West Virginia 


10 


1 


11 


1 


- 


1 


- 


- 


- 


11 


1 


12 


91.7 


North Carolina 


33 


— 


33 


1 


- 


1 


2 


- 


2 


36 


- 


36 


100.0 


South Carolina 


15 


1 


16 


- 


- 


- 


- 


- 


- 


15 


1 


16 


93.8 


Georgia 


19 


3 


22 


1 


- 


1 


- 


- 


- 


20 


3 


23 


87.0 


Florida 


14 


— 


14 


1 

(Table continued 


1 

on 


next page.) 


( 2 


2 


15 


2 


17 


88.3 
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TABLE 1 ( Continued ) 

School Participation in Project TALENT 

The number of schools invited and actually participating btj geographical units and type of school 



Geographical Public Senior Parochial Private All Groups Percent of 

Units High Schools High Schools High Schools Combined Schools Far- 



PARTICIPATING 


Yes 


No ' 


Total 


Yes 


No Total 


Yes 


No 


Total 


Yes 


No 


Total 


ticipating 


Kentucky 


19 




19 


3 


1 


4 


2 




2 


24 


1 


25 


90.0 


Tennessee 


19 


1 


20 


- 


- 


- 


1 




1 


20 


1 


21 


95.2 


cn Alabama 

** Mississippi 


22 


3 


25 


- 


- 


_ 


1 


- 


1 


23 


3 


26 


88.5 


14 


2 


16 


2 


- 


2 


- 


- 


_ 


16 


2 


18 


88.9 


Arkansas 


17 


1 


18 


- 


1 


1 


- 


- 


- 


17 


2 


19 


89.5 


Louisiana 


20 


- 


20 


3 


1 


4 


1 


1 


2 


24 


2 


26 


92.3 


6, Sotithwest 


... 73 


7 


80 


7 


_ 


7 


4 





4 


84 


7 


91 


92.3 


Oklahoma 


21 


1 


22 


1 


- 


1 


1 


_ 


1 


23 


1 


24 


95.8 


Texas 


45 


6 


51 


4 




4 


2 


- 


2 


51 


6 


57 


89.5 


New Mexico 


5 


- 


5 


1 


- 


1 


1 


- 


1 


7 


- 


7 


100.0 


Arizona 


2 


- 


2 


1 


- 


1 


- 


- 


- 


3 


- 


3 


100.0 


7. Rocky Mountains 


... 24 


3 


27 


2 


_ 


2 


2 





2 


28 


3 


31 


90.3 


Montana 


7 


2 


9 


- 


- 


_ 


— 


- 


- 


7 


2 


9 


77.8 


Idaho 


2 


1 


3 


1 


_ 


1 


1 


- 


1 


4 


1 


5 


80.0 


Wyoming 


2 


- 


2 


- 


- 


- 


_ 


- 


- 


2 


- 


2 


100.0 


Colorado 


9 


_ 


9 


1 


- 


1 


_ 


_ 


- 


10 


- 


10 


100.0 


Utah 


4 


- 


4 


- 


- 


- 


1 


- 


1 


5 


- 


5 


100.0 
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8, Far West 


34 


14 


48 


12 


1 


13 


5 


_ 


5 


51 


15 


60 


77.3 


Nevada 


1 


- 


1 


1 




1 


_ 




• 


2 


- 


2 


100.0 


Washington 


9 


1 


10 


2 


- 


2 


2 


- 


2 


13 


1 


14 


92.9 


Oregon 


8 


1 


9 


1 


- 


1 


1 


- 


1 


10 


1 


11 


90.9 


Los Angeles 


2 


2 


4 


1 


1 


2 


- 


- 


- 


3 


3 


6 


50.0 


California ( except 
Los Angeles) 


14 


10 


24 


7 


- 


7 


2 


- 


2 


23 


10 


33 


09.7 


9. N on-contiguous 


... 2 


_ 


2 




_ 


_ 


1 




1 


3 


_ 


3 


100.0 


Alaska 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


- 


— 


Hawaii 


2 


- 


2 


- 


- 


- 


1 


- 


1 


3 


- 


3 


100.0 


Total 


822 


57 


879 


114 


11 


125 


51 


8 


59 


987 


70 


1063 


92.9 
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include a large number of junior high schools and also many 
senior high schools in which the tests were administered to sup- 
plement the regular sample. Thus the total number of schools 
shown here as participants is only 987, while testing was actually 
done in 1,353 schools, 

The success of the effort to get an adequately large and ade- 
quately representative sample was evident, even on the surface, 
in the return mail bringing the acceptances of the schools. Let- 
ters poured in by the hundreds — from urban schools, suburban 
schools, and rural schools; from large schools, small schools, and 
medium-sized schools; from schools in prosperous neighbor- 
hoods, and schools in depressed areas; from schools with tradi- 
tional curricula, and schools with experimental programs; from 
schools in the East, West, North, and South; from academic high 
schools, commercial high schools, industrial high schools, and 
comprehensive high schools. 

The gamut, variety, and expanse of America's secondary school 
system, public and private, were here. But more significantly, 
letters attested to the readiness of principals and teachers to 
take part in a study involving close to a half million of the 
youngsters for whose education and guidance they were respon- 
sible. 




How the 



Tests Were Constructed 



Why we decided to construct a new battery of tests 
rather than to use existing tests . 

How each item in each test was weighed and ana- 
lyzed to give our measuring instruments accuracy and 
precision. We describe the technique of item analysis . 

What the final test battery consists of and how many 
tests it includes . 



w/ 

V V hen a new test battery is to be put together* there are 
two ways of doing it. One is to select a number of tests from 
among the many good ones published by commercial and non- 
commercial agencies. The other way is to develop new tests. 
After serious consideration we decided not to use ready-made 
tests. A good battery of tests is not merely a collection of good 
single tests that happen to be available. A good battery calls for 
a coordination of tests designed to meet a specific purpose. Cen- 
tral to the purpose of Project TALENT was our aim to survey a 
variety of human aptitudes and to obtain scores which might 
predict an individuals ability to develop those aptitudes for 
vocational and educational success. Such a purpose called for 
a large number of fairly short tests, rather than a small number 
of longer tests. While individual scores on longer tests may be 
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more accurate (or to use the technical term, more “reliable"), 
the composite score from a few long tests will probably give less 
accurate predictions of vocational and educational success than 
the composite score from a larger number of shorter tests meas- 
uring a greater variety of aptitudes and abilities* 

Ready-made tests are often of the longer variety, and in any 
case, tests that would otherwise be suitable would not likely be 
the right length for the purposes of this battery. Avoiding un- 
duly long tests was especially important because testing time 
was considerably limited. We had to make the best use of each 
test within the short time period at our disposal. Thus, one major 
advantage of our decision to develop an entirely new battery of 
tests specifically for Project TALENT was that we could control 
the length of the tests, making each as long or as short as seemed 
desirable in order to make the battery as useful as possible for 
many lands of predictions. 

There were other advantages, too. New tests gave us assurance 
that none of them had been taken before by any of the students 
in the study. Further, the tests could be taken out of circulation. 
Their use in the future could be restricted to studies related 
directly to Project TALENT, and to calibration studies that 
establish relationships between the TALENT scores and scores 
on other standardized tests, so that Project TALENT results can 
he applied to those tests. 

The decision to develop a new battery of tests for Project 
TALENT set in motion a chain of events beginning with the 
detailed planning that led to the creation of an experimental 
battery, and to its refinement into the end-product — the battery 
of tests finally used. 



2 

An aircraft or automobile manufacturer does not put his prod- 
uct on the market without first building a model, testing it, and 
then modifying and improving it on the basis of test flights or 
road tests. By the same token, we were not planning to subject 
nearly 500,000 boys and girls to tests without first creating an 
experimental battery, trying it out, and improving it on the basis 
of the tryouts. 
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In developing the experimental battery, we followed these 
steps: 

We reviewed past research and experience in test construction. 

We determined the kinds of teats we would build for the experi- 
mental battery. 

We wrote detailed specifications for each test. Not until then did 
we write the items, organize them into tests, and organize the 
tests into a single battery. 

We arranged for a tryout in a few schools. 

We analyzed the results to deciue which of the tests and which 
of the items to keep in the final products. 

Our review of past research gave us many clues as to the 
kinds of measuring instruments that would be useful for Project 
TALENT. But we knew we had to work within limitations. First, 
there was the limit of time. We could not expect the schools 
to provide more than two days of testing time. Second, the 
tests had to be of the objective type, not only because of their 
greater reliability, but also because only tests that could be 
machine-scored would be practical in testing hundreds of thou- 
sands of individuals. Third, most of the tests had to be of 
reasonably well-established types, because the battery was to be 
based chiefly on what had been learned over the years about 
the art of test construction and about the uses of various kinds 
of tests, rather than on speculation. Most of the tests had to 
measure abilities, aptitudes, and kinds of achievement which 
were of demonstrated importance and predictive value. While 
tests of an experimental nature were not ruled out, they could 
represent no more than a very small fraction of the final battery. 

Before the tests themselves could be written, detailed specifi- 
cations had to be prepared for them, stating not only the number 
and kind of items but also the reasons for using items of that 
type, suggestions for constructing them, characteristics the items 
should have, and characteristics they should not have. On the 
quality of the specifications depends the quality of the final in- 
struments. If the specifications are well done and if the items 
are written to conform with the specifications, the test is far more 
likely to be a good one than if the author dived headlong into 
writing test items. 

Our plans called for a larger number of tests in the experi- 
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mental form than we expected to use in the final battery, since 
it was expected that some tests would be eliminated on the basis 
of the tryout results. In the initial test development stage it was 
better to err in the direction of too many tests than too few. We 
decided to develop experimental forms of 29 tests, plus three 
inventories — an interest inventory, a student activities inventory, 
and a student information blank. The 29 tests are listed in Fig- 
ure 4. 



29. Creativity 

0 A table giving more details about these tests will be found in the 
Appendix, Section A. 

In addition to constructing more tests than we planned to 
use, we also included more items for each test in the experi- 
mental battery than would be needed in the final form. The 
reason was the same: once the test material was subjected to 
tryout and analysis, some of the items would necessarily be 
dropped. 

With construction of the experimental battery completed ac- 
cording to the specifications, we were ready for the tryout. This 
was done in 11 widely separated high schools — large and small; 
rural, urban, and suburban; and located in the Northeast, South, 
and Midwest. All students in Grades 9 through 12 were tested — 
a total of almost 6,000 boys and girls. 

The two main purposes of the tryout, then, were: first, to 
decide what tests were to be included in the final battery and 



FIGURE 4 



Composition of Experimental Test Battery* 



1. Vocabulary-Information Profile 

2. English: Active Vocabulary 

3. Effective Expression 

4. English Usage 

5. Sentence Structure 

6. Punctuation 

7. Capitalization 

8. Spelling 

9. Reading Comprehension 

10. Following Directions 

11. Disguised Words 

12. Words in Sentences 

13. Paired Associates 

14. Sentence Completion 



15. Arithmetic Computation 

16. Arithmetic Reasoning 

17. Mathematics A. (through Grade 9) 

18. Mathematics B. (Grades 10-12) 

19. Verbal Reasoning 

20. Abstract Reasoning 

21. Mechanical Reasoning 

22. Spatial A. Folding 

23. Spatial B. Rotation-Reflection 

24. Scale Reading 

25. Name Comparison 

26. Table Reading 

27. Form Perception 

28. Social Judgments 
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how long they should be; second, to provide a basis for deciding, 
in the case of those tests that were to be in the final battery, 
which test items should be included. What we needed from the 
tryouts were the scores that each student made on each of the 
tests and his response to each item in each test. The information 
on how each student responded to specific items was especially 
important to us, for it was this information, analyzed by an 
electronic computer, which helped us decide which items to 
retain and which to eliminate from the tests. Tins process is 
called "item analysis.” Let us become acquainted with it, be- 
cause the quality of item analysis determines, in part, the quality 
of the final tests. 



3 

Item analysis is a statistical process. As such, it can not substi- 
tute for judgment and care in writing the items — nothing can. 
But item analysis can be an invaluable help. Let’s see how. 

Consider the following general information test item (this is 
not one we would ever have used) : 

A mixture of blue and yellow produces 

A. orange 

B. red 

C. green 

D. white 

E. brown 

This is a poor test item because it is ambiguous; it has two 
defensible answers instead of one. The physicist knows that a 
combination of blue light and yellow light produces white; the 
artist knows that mixing blue pigment and yellow pigment pro- 
duces green pigment. Obviously, then, either C or D would be 
a defensible answer. Now suppose that the author of the item 
does not know much about physical science and thinks that C 
is the only answer. He designates C as the answer. The students 
who know neither about the mixing of pigments nor the mixing 
of colored light rays will have no idea of the answer. They may 
guess any of the choices, or they may omit the item. The stu- 
dents who know about pigment-mixing but not about light- 
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mixing will pick C. The other group of students with partial 
knowledge, those who know about light-mixing but not about 
pigment-mixing, will pick D. But what about those students who 
are best informed? They are the ones who will really be puzzled 
by the item since they may recognize its ambiguity. These stu- 
dents may answer C, or they may answer D, but they are likely 
to omit the item entirely. 

One purpose of an item analysis is to find out what kind of 
total scores on the test are earned by the students who select 
each choice on any particular item. The results for the item 
we have been talking about are likely to be somewhat as follows: 
The students who pick A, B, or E will have lower total scores 
on the average than those who pick C or D; but those who omit 
the item altogether may have the highest scores of all. These 
results serve as a signal that something is wrong with the item. 
Another clue might be provided if, as seems likely, the average 
score of the students who chose D were about as high as the score 
of those who picked the supposed answer, C. If further delving 
revealed exactly what the trouble was, the item could be revised 
and salvaged. Fcr instance, the difficulty could be overcome 
by changing the item to read as follows: 

Mixing blue paint with yellow paint produces 

A. orange paint 

B. red paint 

C. green paint 

D. white paint 

E. brown paint 

Then the item would have only one correct answer, C. 

Now let us look at another test item. Suppose that the fol- 
lowing item were included in a ninth-grade mathematics test: 

The value of rr is closest to 

A. 3.141588 

B. 3.141589 

C. 3.141591 

D. 3.141593 

E. 3.141594 

This is a poor item because it would bo ridiculous to require 
ninth-grade students to memorize the value of tt to that many 
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decimal places, It would be unreasonable to expect it even of 
a professional mathematician. However, if this item did get into 
a mathemr ics test, the results for the item analysis no doubt 
would suggest that good and poor students alike were guessing 
on the item. Probably about the same number of students would 
choose each option, and those who chose option D, the correct 
answer, would not have higher scores on the rest of the test than 
those who chose A, B, C, or E. This item would undoubtedly 
be thrown out of the test, since the item analysis would make 
it immediately apparent that it was too hard. A test item so 
difficult that practically no one in the group for which the test 
was intended knows the answer has no place in the test. Simi- 
larly, item analysis results can point out items that are too easy. 

We analyzed each response to each item in the TALENT ex- 
perimental battery. For each response we computed (with the 
help of machines) the per cent of students reaching the item 
who selected that response, the average tcore achieved by them 
on the test, and an index 1 which indicates the degree to which 
students who picked the response in question tend to have 
higher (or lower) scores than students who picked other 
responses for the same item. 

The same kinds of data were obtained for students who 
reached an item but deliberately omitted it as for those who 
picked a specific option. Thus omission of an item was treated 
as what it really is — a form of response. 

The entire item analysis was carried out separately for the 
lower grades (Grades 9 and 10) and for the upper grades 
(Grades 11 and 12). 

These statistical procedures yielded values which guided us 
in retaining, revising, or rejecting specific items. 

One additional value was obtained for each item — (lie per 
cent of students reaching it. Again this was done separately for 
the upper grades and the lower grades. These percentages pro- 
vided a basis for deciding on the time limits for the tests, or 
alternatively for deciding on the number of items appropriate 
for a given time limit. 

Item analysis provided the basis for revising experimental 
forms of tests to produce final forms of the tests that were to bo 
included in the final battery. But the item analysis alone was 

1 Statistician* call this a "point bUcHat correlation coefficient.* 
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not a good basis for deciding whether a test should be included, 
Other facts were needed for that decision. The main problem 
here was efficient use of testing time. We wanted the final 
battery to consist of tests that would measure as many different 
things as possible and overlap each other as little as possible. 
We wanted each test to be adequately reliable and at the same 
time we wanted to make certain that each test would make a 
unique contribution to the battery. How this was done (see 
Appendix, Section B) is of more interest to the expert than to 
the lay reader. What needs to be recorded here is that on the 
basis of consideration of the available facts, we decided to 
eliminate four tests that were in the experimental battery, revise 
a few tests substantially, and make only minor revisions in most 
of the others. 

We also decided to allot five minutes apiece for each of two 
very brief themes to be written by the students. These themes 
were to be on the topics, “What High School Means to Me” 
and “My Views About an Ideal Occupation.” 



4 

After the general decisions had been made as to content of 
the final battery, one decision still remained before the tests 
could be revised and organized into a single, integrated battery. 
This was the question of how the various parts of the battery 
were to be handled in the initial phase of the data processing. 

It seems advisable to anticipate Chapter 11 at this point by 
indicating that two different kinds of machines — a “scoring 
machine” and a “document reader” — were available for use in 
the initial processing. These are described in detail in Chap- 
ter 11. At this point it will suffice to say that the scoring machine, 
as its name implies, yields “scores” on sets of items. The docu- 
ment reader, on the other hand, records specific responses with- 
out scoring them. 

It was decided to arrange the battery so that all of the stu- 
dents* responses would fit on five answer sheets, two of which 
would bo processed on the scoring machine and the remaining 
three on the document reader. Document reader answe* sheets 
would include the Student Information Blank, the Interest In- 
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ventory, and basic information data — students name, address, 
sex, date of birth, grade in school. The scoring machine answer 
sheets would include the Student Activities Inventory and all of 
the tests except the Information Test. The Information Test 
posed a problem both because it had so many items and be- 
cause some of the items were of such a nature that it seemed 
appropriate to score them individually. The solution was simple. 
The Information Test was split into two parts. Part I responses 
would be put on an answer sheet earmarked for the scoring 
machine; Part II responses would be put on an answer sheet 
of the type to be processed by the document reader. 

Having settled these problems, we ■''re in a position to com- 
plete the jigsaw puzzle by combining ail the pieces — the tests, 
three inventories, two themes, and an instrument containing basic 
identifying information — to form a single, fully organized bat- 
tery. The composition of the final battery is shown in Figure 5. 



FIGURE 5 

Composition of the Final Project TALENT Battery 0 

APTITUDE AND ACHIEVEMENT TESTS 



1. Information Tost 


12. Creativity 


2. Memory for Sentences 


13. Mechanical Reasoning 


3. Memory for Words 


14. Visualization in Two Dimensions 


4. Disguised Words 


15. Visualization in Threo Dimensions 


5. English: Spelling 


16. Abstract Roasontng 


6. Capitalization 


17. Mathematics: Arithmetic Reasoning 


7, Punctuation 


18. Introductory 


8. English Usage 


19. Advanced 


9. Effective Expression 


20. Arithmetic Computation 


10. Word Functions In Sentences 


21, Table Reading 


11. Reading Comprehension 


22. Clerical Checking 


23. Obfect Inspection 


MISCELLANEOUS 


INVENTORIES 


Preferences Tost 


Student Activities Inventory 


Themes 


Interest Inventory 




Student Information Blank 



* A tablo giving details about these tests will bo found in tho Appendix, 
Section C. 



i Physically, tho final battery consists of five test book ? jts and 

five separate answer sheets. The five test booklets were desig- 
nated A, B, Cl, C2, and CIx. The five answer sheets were 
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designated A, Bl, B2, C and Z. Answer Sheet Z is the "Master 
Record Form’ 1 containing the student’s name, address, and other 
identifying information. 

After all materials were completed and organized into proper 
place and sequence, we put the entire new battery to one more 
trial — a full-scale “dress rehearsal/’ This took place in Feb- 
ruary, 1960. The stage was Preston High School, Preston, 
Maryland, where the full two days of the battery were admin- 
istered. Since things went smoothly, only a few minor changes 
in time limits were necessary before the presses could start roll- 
ing to turn out materials for the full testing program. 




The Tests: Their 



History and Content - 1 



Here we begin io describe the tests in Project 
TALENT's battery. This chapter is devoted to a 
description of the far-ranging Information Test . It in - 
eludes test items on vocabulary, literature, social stud- 
ies, mathematics, physical science, biological science, 
music, art, home economics' — and this is but a partial 
list The Information Test also measures the student* s 
acquaintance with mechanical, electrical, electronic , 
aeronautics and space information . 

We present sample after sample of test items to 
show the kinds of questions which the students had to 
answer , l Equally important is the reasoning that went 
into the building of each phase of the Information 
Test . 



jesting has a long history — probably as long as the history 
of schools. Standardized objective tests reach back into the late 
19th century. They were given their first impetus by such great 
pioneers as Binet, Gallon, nod Spearman. In 1897, Joseph M. 
Rico developed a standardized spelling test and through it dem- 
onstrated what he later called the “futility of the spelling grind.” 

1 Test items and other material reproduced in this volume from the 
original battery of Project TALENT tests nro used with the permission of 
the copyright owners, University of Pittsburgh. 

COPYRIOHT 0 1960 UNIVERSITY OP PITTSBUROH. 
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From these and other early efforts have come, over the past half 
century, an increasing number of standardized tests which have 
steadily improved in effectiveness. 

As we in Project TALENT began to develop our battery, we 
had a vast storehouse of experience to draw on. We reviewed 
the work of the countless experimenters during the past six dec- 
ades, so that we could utilize, or adapt to our needs, the best of 
their ideas, and the principles of test construction that had been 
arduously developed. 

What were the antecedents, characteristics, and contents of the 
tests we finally laid before the students taking part in our study? 
Section C of the Appendix summarizes some features of the tests. 
But the extent and range of the TALENT tests can be better 
grasped by dividing them into two components — (1) the In- 
formation Test, and (2) a group of 17 other tests — measuring 
many different aptitudes, as well as achievement in several areas. 
The present chapter deals solely with the first of these com- 
ponents — the Information Test. 



2 

The Information Test is really several tests rolled into one. Its 
purpose is multiple. The test may be so scored as to measure the 
breadth of the students general information, his vocabulary 
level, and the amount of information he has in many specific 
areas. But the te; t was designed to do much more: to help 
in identifying mentally retarded students and others who read 
so poorly as to be considered functionally illiterate; to help 
us identify students whose attitude toward taking the test is flip- 
pant or apathetic and students whose scores may be pulled down 
by careless errors; finally, to help determine a student's general 
attitude toward natural phenomena — whether he tends to take 
a scientific view in evaluating hypotheses, or whether his gen- 
eral attitude makes him receptive to explanations which are 
superstitious or otherwise illogical. 

This is a large assignment for a single test — even one as long 
as the Information Test. However, many of the items have mul- 
tiple functions. For example, the items designed to identify 
illiterates also help to identify the inadequately motivated stu- 
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dents — provided that the entire pattern of scores is taken into 
account and that the results are properly interpreted. A fnd 
every item, regardless of what else it measures, also contributes 
to the total “general information’' score. 

Let’s examine more closely each of the purposes for which the 
Information Test is designed, and the historical background that 
preceded the development of this test. 

1. Measures of breadth of general information . Information 
tests covering a wide range of topics have been used as com- 
ponents of general intelligence tests as far back as World War I, 
when the Army Alpha test was given to all recruits who could 
read and write. One of the eight subtests of the Army Alpha 
was a test of information, covering a wide range of subject mat- 
ter. For instance, it included items testing information on ani- 
mals and birds, physical science, biological science, farming, 
mechanics, social studies, electricity, medicine, games, business, 
foods, airplanes, sports, guns, law, literature and art. Arthur S. 
Otis, who played a leading role in the development of the Army 
Alpha, later used information items as one of the chief com- 
ponents of his widely used intelligence tests (the Otis Self- 
Administering Tests of Mental Ability and the Otis Quick-Scoring 
Mental Ability Tests). 

Information tests as indicators of general intelligence have been 
considered important from the time they were first developed 
and are still so considered. 

2. Measures of interest. In the 1930's there was some experi- 
mentation with information and vocabulary tests to measure in- 
terest patterns. For instance, there was the Michigan Vocabulary 
Profile Test, developed by E. B. Greene in 1937. This test con- 
sisted of eight subtests, measuring vocabulary in human relations, 
commerce, government, physical science, biological science, 
mathematics, fine arts, and sports. The total score on tins test 
provides a measure of general vocabulary. But the innovation 
which distinguished this test from its predecessors was the rec- 
ommendation that the profile of subtest scores be used to provide 
a clue to a person's relative interests in different areas. Such a 
suggestion was based on the premise that the individual will 
tend to know a good deal about areas in which he has a deep 
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interest. Thus, if the profile of his subscores shows peaks and 
valleys, these extremes may be taken to suggest areas where his 
interests, and thus perhaps his ability to succeed, are greatest 
and least. 

The use of information tests to suggest whether an individual 
has sufficient interest in an activity to succeed in it was greatly 
expanded and systematized during World War II in the Army 
Air Force Aviation Psychology Program. It proved successful in 
the battery of Aircrew Classification Tests designed to predict 
success as a pilot, bombardier, or navigator. 

A battery later developed by the American Institute for Re- 
search to select airline pilots and flight engineers made use of 
many principles and methods which had proved effective in the 
Air Force. Among them was the use of information tests to pro- 
vide an “operational” measure of interest in flying — a measure 
based not merely on claiming interest, but on demonstration of 
interest by the acquisition of information. The extent to which 
knowledge about flying indicates a specialized interest rather 
than merely the acquisition of a wide range of information can 
be determined by comparing a flying information score with 
one based on other information, or with the total information 
score. 

2 Measures of information in specific areas. In addition to 
indicating relative interest in different areas, subscores on a gen- 
eral information test are also useful as direct measures of the 
amount of information acquired in an area — for instance, physi- 
cal science, fine arts, or sports. The Michigan Vocabulary Profile 
Test, which has already been mentioned, provides such scores. 

Are such scores measure of achievement, or do they measure 
aptitude? Tiie answer is, they can measure either, or both, de- 
pending on the way the scores are interpreted and used. Acqui- 
sition of information in a particular area, such as science, certainly 
represents a kind of achievement. And, in the sense that past 
performance predicts future performance, achievement would 
constitute an index of aptitude. In fact, there are certain areas 
in which these joint achievement-aptitude tests based on amount 
of information acquired have proved outstandingly useful as 
predictors or indicators of job aptitudes. Among the areas to 
which this would apply are mechanics, electrical and electronic 
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work, and aeronautics. The TALENT Information Test items in 
these three areas may thus be regarded not only as contributing 
to the total Information score, but also as constituting important 
separate tests in their own right. These three areas are discussed 
separately later in the chapter. 

4. Measures of vocabulary . The size of a person \s general 
vocabulary has long been recognized as one of the best indices 
of that aspect of general intelligence called "verbal intelligence” 
Vocabulary tests have played a role in intelligence testing ever 
since the Binet scale was developed in 1905. Almost every in- 
telligence test (except those specifically designed to be non- 
verbal) contains either a vocabulary subtest or vocabulary items 
scattered throughout the test. 

There are more ways to measure a person's vocabulary than by 
listening to his conversation. Standardized paper-and-pencil tests 
are a much better way. Vocabulary items can take many forms 
— such as the following: 

a. Verbal analogy items 

Item 1. “Hand” is to “gauntlet” as "sword” is to 

A. attack. 

B. armor. 

C. shield. 

D. spear. 

E. scabbard. 

(The answer is E.) 

b. Opposites items (antonym items) 

Directions: Choose the word that is most nearly opposite in 
meaning to the given word. 

Item 2, Hope 

A. Dislike 

B. Despair 

C. Wish 

D. Fail 

E. Criticize 

(The answer is B.) 
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c, Synonym items 

Directions: Choose the word that has most nearly the same 
meaning as tho given word. 

Item 3. Apparel 

A. Appearance 

13, Illusion 

C. Luggage 

D. Clothing 

E. Elegance 

(The answer is D.) 

d. Same-opposite items 

Directions: Each item consists of five words. Find the two that 
arc most nearly the same in meaning or the opposite 
in meaning. 

Item 4. 



A. Adjust 
13. Admit 

C. Adapt 

D. Adept 

E. Advise 

(The answer is the pair A and C.) 

e. Definition items 
It to: 5. Suffrage is the right to 

A. petition. 

B. vote. 

C. assemble. 

D. worship. 

E. work, 

(The answer is B.) 

5. Identification of illiterates and persons with severe reading 
disabilities. Among the items in the Information subtest of the 
Army Alpha were some extremely easy ones, put in to screen 
illiterates. For instance, one asked whether it was more likely 
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to snow in winter than in summer; another dealt with the fact 
that eggs come from hens. Tests developed after the Army Alpha 
have also used this method to spot illiterates. The usual pro- 
cedure is to incorporate these simple items with the items of 
normal difficulty in a single score. It is not customary to obtain 
a separate score on the extra easy items. However, a separate 
score on these items was obtained by Project TALENT in an 
effort to identify students whose reading skills arc so inadequate 
that their scores on the rest of the Information Tests and other 
tests in the battery would be invalidated by failure to understand 
the items. 

6. Measures of motivational factors . A poor score on items so 
ensy that anyone who can read and write should bo able to an- 
swer all correctly usually indicates either illiteracy or a severe 
reading disability. If these explanations do not fit, the next most 
probable explanation is that the attitude of the person taking the 
test leaves much to be desired. Or the low score may be due to 
flippancy (manifested by deliberately marking the wrong an- 
swers ) or to apathy and indifference. Another possibility is that 
the low score may be duo to unusual proneness to clerical errors. 

Obviously the low score docs not come with a label attached 
telling which is the right explanation. However, reasonably ac- 
curate inferences may be drawn on the basis of the entire pattern 
of the student s scores on the rest of the tests. 

7, Measures of scientific attitude . Interspersed among the 
items of the Project TALENT Information Test is a new kind of 
item designed to measure scientific attitude. This is one of the 
Project's experimental ventures in testing. It will be discussed 
at the end of this chapter. 



3 

We are now ready to look more closely at the TALENT In- 
formation Test, It consists of 395 items. All of them, with the 
exception of ten inserted to measure scientific attitude, test 
factual information. The ten scientific attitude items require a 
composite of information, scientific attitude, and judgment. 
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The Information Teat wan divided into two parti on the bad* 
of whether subscorcs w^ e to be punched on the Scoring Ma* 
chin<? or whether specific ite..i tapemses were to bo punched on 
the Document Header* Part 1 can yield 15 iubseorc# and a ioorc 
representing the ium of the rubscorci — that fs, 10 scores in all. 
But potentially the test can yield a very large number of add!* 
Uonal scores, since the items in Part 11, for which individual re* 
sponscs were punched on the Document Header, can be com* 
blncd and recombined in any way desired* They can also be 
combined in any way with some or all of the 15 subsoorcs ob* 
tained in Part 1. Thus, scales can be tailor*madc for specific pur- 
poses and for predicting success in particular occupations. The 
tallor*made scale can be made by combining whatever test items 
seem best for the specific purpose. 

TABLE 2 

Content of Information Test 



Taut I or Test* 

1. .Screening (of illiterate* ami 

(filter*) 

2. Vocalmlary 

3. Literature 

4. Music 

5. Social Studies 
0. Mathematic* 

7. Physical Science 

8. Biological Science 
0. Scientific Attitude 

10. Aeronautic* and Space 

11. Electricity and Eltx ronlcs 

12. Mechanic* 

A* Tools, construction 
D. Motor* and tncclmnUm* 

13. Farming 

A. Farm 

B. Ranch 

14. Horn* Economic* 

A. Cooking 

B. Other 

15. Sport* 



Number of Itemi 
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Let uk look at some of the scales which have Iscrn constructed 
from the store* on item* included in the Information Tost, 

Vocabulary. The items of the vocabulary scale in the informa- 
Uon Test are designed to measure a student's general vocabulary. 
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Although the distinction between general and technical or spe- 
cialized vocalwlary U not precise, general voealwilary can be 
considered In consist of wonls that educated person* might rea- 
sonably lx* ©spectre! \o know, whether they have had specialized 
training in a particular area or not. 

An an ©sample of the type of vneatmlary item* used, note the 
following! 



Item fl, Which of these objects 
in usually spherical? 

A, A water glass 
ft. An orange 

C, A doughnut 

D. A dime 
K, A cone 

(the flnm'er Ik It.) 



Item “ The gove rn men t of the 
United State* is called 
“federal* because it has 

A a president, 

B. three separate 
branches. 

C, free elections, 

D, separate state*. 

E. separation of Chinch 
and Slate. 

(The answer i% D.) 



Item H, Another word meaning tv pro U 

A> wain, 

B. gas. 

C. liquid. 

IX condensation. 

E. solid. 

(The answer Is It.) 

The terms ipforfauf, federal, and vapor represent conoepli 
from mathematics, social studies, and physical science, respec- 
tively, but they are also part of a person*# general vocabulary, 
The inclusion of such wmd§ is one way (a relatively minor way, 
perhaps, but nevertheless one that might have interesting re- 
sults) in which the TALENT vocabulary scale differ# from many 
widely used vocabulary tests which appear to be limited to word# 
of a rather “literary* character. Although the TALENT vocab- 
ulary items cover a wider tange of words than items In these 
other tests, still the TALENT items do not include words of 
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highly specialized character — lor Instance, binomial or apothem 
(mathematics term*)} ftockei botoueh* fief (social studies tem»s)j 
halogen, ohm (physical science terms). Items on stieh words 
could legitimately go In the approbate subject-matter scale, but 
not In the vocalndary scale, lor such terms depend mote on spe* 
dallzcd training In the particular area than on general level of 
vocalndary. 

The vocabulary score estimates ahltify to comprehend words, 
not alrlllty to select and use the appropriate word to esprest one’s 
meaning, Nor are line differentiations In meanings a matter of 
concern. Tints, although the dictionary Indicates a slight differ* 
cute In Implication between questionable and doubtful , the 
meanings arc sufficiently similar that for purposes of the TALENT 
vocabulary scale the two words can 1« considered synonymous. 
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In addition to the measure of vocalndary, the 'information Test 
yields a series of suhscercs measuring a student’s acquisition of 
fads in holh academic and nomarademlc suhjeds. Tire test items 
were so constructed that a pupil's answers would tdled his 
formal education as well as leatning he had acquired outside the 
classroom thiough reading radio, teleslsion, Itrowsing listening 
or tinkering. 

IMcralurt Tire purpose of this scale is to measure the pupff'i 
familiarity w,0i the world of literature. There is no common 
Irody of literature to which all high school students are likely to 
have Ireen exposed. No two lists of required or recommended 
reading issued hy schools ate identical. In fad, it is probable 
tltat any two such lists would differ considerably. Even so, there 
is usually considerable overlap. Tims, the hroad coverage of the 
Information Test items dealing with literature makes it likely 
that students who have acquired the habit of reading will get 
reasonably good scores — provided their reading is above the 
comic-book level and not limited to the “how-to-build-it-your* 
self" type. 

In deseloping the literature scale, we made su;e that both 
poetry and prose were represented, including literature for ad* 
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nlesecnts and aduit* as well an children. Emphasis was placed 
on (letns to test knowledge that would be acquired chiefly by 
reading the lltmty work In question, rather than merely by 
reading about It Items were included about characteristic* of 
the principal characters, plot, and settings. 

The following are sample items t 

Itrm 9. Which ot these was a knight of King Arthur 4 * Pound 
Table? 

A. Alfml 

B. Lancelot 

C. M^lin 

D. tvanhnc 
E> Poland 

(The answer is B.) 

turn 10. Othello's motive for murder was 

A. *elf-dcfcn*r. 

B. jealousy, 

C. fear. 

D. craving for pmvrr, 

E. greed for gold. 

(Tbc answer is It) 

Item II. Each line of Blank verse hat 

A, Gfcet. 

, B, 10 feet. 

C. 3 feet. 

D. 4 feet. 

E. 5 feet. 



(The answer is E.) 

Soctof Studies This scale covers facts and concepts fr*m 
history, economics, government and dvics, geography, and cur- 
rent affairs. At least half of the history, government, and geog- 
raphy items are concerned with the United States, but the rest 
of the world Is not neglected. The sampling of material on United 
States history covers periods from the discovery of America to 
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the present, and includes political, economic, industrial, and 
military developments* 

No items that seemed likely to Wome dated within 20 years 
or whose significance seemed likely to change markedly within 
that period were included in the test* However, this did not pre* 
elude items on topic* of current concern which still probably 
l>e of continuing interest lor a long time. 

Materials not necessarily taught in high school were not rigidly 
deluded from the test since it was felt that acquisition of knmvl* 
edge almut such materials through voluntary reading nr in other 
ways indicates special interest in the area, 

Tin? following are sample items* 

Item 12, Which of these is specifically mjufred by tlie U.S. 
Constitution? 

A. Supiemc Court 
II. Political parties 
C. Con gmssiooal committers 
I), Nominating conventions 
E, Cabinet 

(The answer is A,) 

Item II Most of the people of India are 

A* Moslem. 

II, lluddhUt, 

C. Christian. 

I). Ccmfiician. 

I* Hindu. 

(The answer is E.) 

Item N, Napoleon was empeior of France around the beginning 
of the 

A. tilth century. 

II. Itith century. 

Cl 1 7th century. 

I), I Hth century. 

K. 10th century. 

(The answer is E,} 
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Aldf/icrmif/c*. The area ol mathematics, unlike other academic 
subject matter areas, I* represented not only In the Information 
Test, but In two other Project TALENT tests t tho Arithmetic 
Computation Test and the Mathematics Test* 

However, flic mathematics Items in the Information Test do 
not overlap the content of these other tests since the Information 
Test Items arc concerned with knowledge of facts, not with 
mathematics skills, None of the Information items requires com- 
putation, reasoning, or problemsolving — these processes arc 
covered in other tests, Nearly half of the Hems arc on topics 
studied In Grade 9 or earlier; the others arc concerned with 
topics usually not touched upon until at least the 10th grade; 
and some call for Information that might he acquired In ways 
other than through classroom mathematics. 

Tlic history of mathematics was not Included, since there Is 
some evidence that Hems of this type arc less satisfactory !ndl- 
cators of Interest in such an area than Items testing knowledge 
of the current field. 

Hie content sampled Includes definitions, the vocabulary of 
mathematics, conventions of mathematical notation, and the un- 
derstanding of concepts such as fractions, decimals, percents, 
factors, equations, planes, angles, logarithms, and exponents. 

Sample Items follow; 

Item Ilf. "3b + 2b* = 5" is called 

A. a coefficient. 

B. an equation. 

C. a formula. 

D. an unknown. 

E. an identity. 

(The answer Is B.) 

Item 10. An ordinary slide rule Is designee* for 

A. computing. 

B. measuring length. 

C. measuring angles. 

D. weighing. 

E. reading tables. 

(The answer Is A.) 
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Physical science* This scale comprises Items from chemistry, 
physics, astronomy, and other physical sciences. Included were 
science topics taught In elementary and secondary school, m 
well as Items on Information that might readily be acquired In 
ways other tlmn through formal Instruction. It was felt that ac- 
qulsition of such knowledge through voluntary rending and ex- 
perimentation would Indicate a special Interest In the area. 

Sample Items follow: 

Item 17. Ozone is a form of 

A. electricity. 

Ik air. 

C. oxygen. 

D. nitrogen. 

12. carbon dioxide. 

(The answer is C.) 

Item 18. Gravitation is the force which causes a rubber ball to 

A. bounce. 

B. go flat. 

C. keep its shape. 

D. fall when dropped. 

E. change shape when pressed. 

(The answer Is D.) 

Item 10. A "light year" is a unit of 

A. temperature. 

B. volume. 

C. brightness. 

D. distance. 

E. speed. 

(The answer is D. ) 

Biological science. This scale includes items from the fields 
of botany, zoology, and microbiology. Nature lore is covered 
because its acquisition would indicate a special interest in one 
area of the biological sciences. 

A sample item follows: 
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Item 20. The substance which makes plants green is 

A. cellulose. 

B. starch. 

C. chlorophyll. 

D. sap. 

E. fungus. 

(The answer is C.) 

Music. While these items are not indicative of musical talent, 
those who enjoy going to concerts or listening to music on the 
radio and phonograph should do well on them. 

Here is a sample item: 

Item 21. Who wrote “Peter and the Wolf”? 

A. Prokofiev 

B. Bach 

C. Tschaikowsky 

D. Dukas 

E. Mozart 

(The answer is A.) 

Art. This scale measures knowledge about art which may 
have been acquired through participating in art as a hobby or 
for personal expression. Those who enjoy going to museums and 
art galleries, reading about art, and dabbling in it should have 
an advantage on these items — as should those who have had 
special training in art. However, there is no reason to think that 
this scale will identify those with creative talents in art. 

Two sample items follow: 

Item 22. Easels are used by 

A. sculptors. 

B. musicians. 

C. surgeons. 

D. lawyers. 

E. painters. 




(The answer is E.) 
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Item 23. Which of these is not the name of a famous painter? 

A. Titian 

B. Rubens 

C. C6znnne 

D. Napoli 

E. Van Dyck 

(The answer is D.) 

Home economics. Students who have done some cooking or 
sewing, those who have engaged in relevant activities' as a part- 
time job (for example, baby-sitting), and those who have taken 
home economics courses should have an advantage on these 
items, 

A sample item follows: 

Item 24. In a recipe calling for one cup of butter, you should 

use 



A. one pound. 

B. two pounds. 

C. a half-pound. 

D. a quarter-pound 

E. one-eighth pound. 

(The answer is C.) 

Law. These items primarily measure “general information,” 
so that a good score on this scale is not necessarily indicative of 
interest in law, Nevertheless it seems probable that a student 
whose score in this area is relatively low is not likely to have 
enough interest in law to make it an advisable career for him. 
Here are two sample items: 

Item 25. What kind of degree do most lawyers have from law 
school? 

A. B.A. 

B. B.S. 

C. PhD. 

D. LL.D. 

E. LL.B. 

(The answer is E.) 
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Item 26. A coroner s chief function is to investigate 

A. mysterious deaths. 

B. burglaries. 

C. counterfeiting rings. 

D. kidnapping cases. 

E. accusations of bribery. 

(The answer is A.) 

Health . Among the areas sampled are knowledge of physiol- 
ogy, nutrition, first aid, common ailments, physicians* instru- 
ments, and training requirements for medical and nursing 
careers. 

Here is a sample item: 

Item 27. A deficiency disease is a disease caused by 

A. a virus. 

B. improper diet 

C. not getting inoculated. 

D. defective glands. 

E. poor heredity. 

(The answer is B.) 

Architecture . Those who have read books and articles about 
architecture and students whose interest has manifested itself in 
other ways — for instance, through conscious observation c £ the 
architecture around them — should do well on these items. 

Farming, These items are intended to give some representa- 
tion to the information that children who grow up on farms or 
ranches are likely to acquire. The items might give some ad- 
vantage to those who have an interest in rural life. 

Theater . These items should indicate an interest in the the- 
ater. (It is somewhat doubtful, however, that it is possible to 
get much differentiation between those who are interested in the 
stage as a career and those who merely are interested spectators. ) 
Most of the items deal with theater terms (for example, grease- 
paint, footlights). 

Here is a sample item: 
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Itcjn 28, An ing<5nuo rolo in a play usually calls for 

A. exceptional acting ability, 

B. great beauty. 

C. youthfulness. 

D. a sophisticated manner. 

E. skill as a comedian. 

(The answer is C.) 

Photography. These items should test information that is ac- 
quired principally through photography as a hobby, and also, to 
a certain extent, information picked up through reading about 
photography, attending exhibits, and manifesting interest in other 
ways. 
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We now come to a discussion of three scales dealing with a 
student's acquisition of facts about the world of technology. 
Three areas are under consideration — mechanical, electrical 
and electronic, and aeronautic and space information. The test 
items for all three were dispersed throughout the Information 
Test. 

Mechanical Information. The assum] ‘ion underlying 1 this 
scale is that anyone who has both aptitude for mechanical work 
and interest in it will probably manage in one way or another to 
acquire considerable information about it It is assumed that 
he would be likely to acquire such information whether or not 
the igh school he attended offered formal instruction in me- 
chanical subjects. 

Among the first standardized tesCs of mechanical information 
were the early trade tests developed for use in the Army during 
World War I. In the early tests of mechanical information, un- 
like the more recent ones, no distinction was made between me- 
chanical information (tools, materials, mechanics, carpentry, cab- 
inet making, painting, printing, etc.) and electrical information. 
In current practice, electrical and electronic information are 
often covered in a separate test since individuals who do well in 
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mechanical information tests are not necessarily well informed 
in electricity and electronics, and vice versa. Contemporary tests 
of mechanical information have proved useful for predicting 
success ns an aircraft mechanic, auto mechanic, radio repairman, 
radar repairman, machinist, sheet metal worker, or welder. In 
World War II, the Army, Navy, and Air Force made extensive 
use of mechanical information tests with considerable success. 
Frequently mechanical information items are pictorial rather 
than verbal; and if verbal items are used, nn effort is usually 
made to keep the wording simple. 

The TALENT mechanical information items are of the verbal, 
rather than pictorial type. Each item falls into one of two cate- 
gories: (1) information about to ds, carpentry, and other kinds 
of construction, or (2) information about motors and other kinds 
of mechanisms. The items arc about equally divided between 
the two categories. However, this is not important except as a 
way of insuring breadth of coverage, since students who do well 
on one type of item tend to do well on the other. 

The test taps a wide range of mechanical information — about 
automobiles, common machines, tools. The emphasis is on in- 
formation acquired through direct experience with tools and 
motors. The wide variety of information covered tend$ to equal- 
ize the opportunities of boys in urban and rural environments to 
score well and helps to make the scores comparable. 

A sample item follows: 

Item 29, Which of these tools is best for rough-shaping wood? 

A. Rasp 

B. Plane 

C. Level 

D. Awl 

E. File 

(The answer is A.) 

In interpreting scores on this test, past mechanical experience 
or formal training in mechanics should, of course, be considered. 
Certainly, too, the sex of the individual should be borne in mind 
in interpreting a score, since pronounced sex differences are usu- 
ally found in scores on mechanical information. In general, those 
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who score well on these Items will tend to do well In training for 
a wide variety of mechanical occupations — for Instance, ma- 
chinist* artillery mechanic, sheet metal worker, foundrymun, air- 
craft mechanic, and auto mechanic. 

Electrical and Electronic Information, Till* scale is intended 
to serve a* a predictor of success tn such Jobs as electrician, elec- 
tronic technician, or radio and television repairman. 

Extensive use of electrical and electronic Information tests ns 
predictors of fob success dates back to about World War 11. At 
that time, the military services found that tests of electrical and 
electronic information were useful In Identifying persons who 
would make good electricians or electronic technicians ( though 
not necessarily good mechanics). This sort of test was therefore 
used extensively and successfully in assigning military personnel 
to specific training programs. Ever since then It has been real- 
ized that the occupational fields represented by mechanical Jobs 
und electrical Jobs arc functionally different. Civilian versions of 
electrical and electronic Information tests for i sc In selection and 
counseling were not developed until recently. Such tests have 
proved ttscfitl in predicting success in numerous Jobs, including 
electrician, electronic technician, radio repairman, and radar 
repairman. 

Most of the TALENT electricity and electronics items are of 
the verbal type, although a few involve diagrams, The items 
stress Information acquirable through direct experience in the 
construction and mai..tcnance of electrical and electronic equip- 
ment. Titus, examinees who have worked on radios, hi-fi sets, or 
other electronic equipment, for instance, would have an advan- 
tage. It is inevitable that some of the Items could also be an- 
swered on the basis of information acquired in formal courses 
In physics and to a lesser extent in chemistry. However, items 
that can be answered on this basis even by persons who have not 
had much direct experience with electrical or electronic equip- 
ment were kept to a minimum. 

Scores on this scale are considerably affected by past experi- 
ence in the area, but since a broad range of content is covered, 
the average high school student will probably have had an op- 
portunity to acquire a fair amount of the information tested If 
he is at all Interested in the area and has any aptitude for it. 
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In other worth, those who get good scores arc likely to have both 
interest In the field and aptitude for It. They could probably 
complete successfully any training course In the area. A low 
s^orc docs not indicate that a youngster lacks the ability to learn 
this kind of material If lie Is exposed to It. However, If he has 
not been exposed by age 16 or 18, the chances for surecss In 
electronics or electrical training programs would be substantially 
lowered. 

Aeronautics and Space Information . Tills scale Is Intended to 
help Identify students whose interests and aptitudes suggest they 
would be successful pilots. 

As has already been indicated, among the discoveries made by 
the Aviation Psychology Research Program during World War 
II was the fact that one of the tests that made an Important con- 
tribution to the prediction of success in pilot training was an In- 
formation test heavily loaded with questions about aeronautics 
and related topics, lienee, the Information Test included somo 
Items on such topics as flying procedures, navigation, jet aircraft, 
and space exploration. 
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Scientific Attitude Scale . These Items provide a subscorc 
which should be Indicative of how the individual views the 
world — whether he views it as a place where there arc logical 
cnusc-and-cfTcct relationships, or whether he rcg«™U It us a place 
where consequences arc illogical and arbitrary. In the latter 
category fall the modern-day equivalents of the primitive beliefs 
that have been called "sympathetic magic/’ Also in the category 
of illogical and arbitrary consequences arc the premises of palm- 
istry, astrology, and numerology. 

Each item consists of a description of a phenomenon or an 
occurrence. Five explanations are presented, and the task is to 
select the "best** one. Only one of the five explanations is reason- 
able and logical. Of the other four, some involve common super- 
stitions, magic, concepts incompatible with the scientific view- 
point, or belief in the occult. Selection of other detractors, 
howover, may primarily imply muddled thinking on the part of 



Tins itsth: nisTonv and content — 1 80 

the examinee, (An example of the latter kind of detractor would 
be Option C in Sample Item 30, below.) 

None of the Items requires special Information In science or 
mathematics. Whenever such Information Is needed to answer 
the question, It Is presented in the item Itself. For Instance, in 
Sample Item 31 below, the odds on ten coins falling “heads up" 
are stated, In round numbers, In the Item. 

Here are two sample Items: 

Item 30 . Jim Wilson has entered many golf tournaments but 
lias never won one. He usually docs very well until 
the finals. Dut in the finals when the score is close, 
ho tends to make a few wild shots, which result in his 
defeat. The best explanation of Wilson s failure to win 
a tournament is that 

A. lie is just naturally unlucky. 

B. he “goes to pieces” under pressure. 

C. he hasn't practiced. 

D. lie doesn't really care whether he wins. 

E. his opponents arc just naturally lucky. 

(The answer is B.) 

Item 31 . Professor Rogers wished to find out whether any of 
the 950 students in Central High School could demon- 
strate the power of “mind over matter.” When ten 
pennies arc tossed, the chances that all ten of them 
will fall “heads up” are about one in a thousand. 
Rogers had each student in turn toss ten pennies. He 
instructed them to try, by thinking very hard about it, 
to make all ten pennies fall “heads up.” But when 
ono of tho boys, Joe Thompson, tossed the coins they 
all fell “tails up.” What docs this suggest about Joe? 

A. Joe was purposely trying to get all tails. 

B. Joe became confused. 

C. Joe didn’t have faith in the power of mind over 
matter. 

D. Joe is unlucky. 

E. Nothing. 

(The answer is E.) 

The Scientific Attitude scale is strictly experimental. We hope 
it will prove helpful in assessing scientific aptitude. 
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Our description of the tests continues . Here we deal 
with tests for memory for sentences, memory for 
words, and disguised words . We next describe the 
purpose and content for a group of tests of ability to 
use and comprehend the English language . Following 
that, we give an account of the tests dealing ivith 
creativity, mechanical reasoning, visualization, mathe- 
matical reasoning, and arithmetic computation . Fi- 
nally, tests of table reading, clerical checking, and. 
object inspection are described . 

This chapter also discusses our preferences test and 
tells why we asked each student to write two themes 
— on “What High School Means to Me” and “My 
Views of an Ideal Occupation ” 
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I he probing for patterns of aptitude and ability continued by 
means of tests which sought more than a student’s fact-absorbing 
capacities. 

Previous research had indicated that human ability depends 
heavily on memory (probably more than one kind), language 
and mathematical skills, and ability to visualize movement in 
two or three dimensions. But perhaps central in the aptitude 
pattern are reasoning ability and creativity. 

Therefore, in addition to testing knowledge of facts by using 
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tho Information Test wo tested for llie wide range of abilities 
suggested above. The nature and background of the tests used 
for these purposes are described below. 

Mkmoiiy eon Sentences 

There are several different aspects of memory. Which of the 
various aspects of memory docs the TALENT Memory for Sen- 
tences Test include? 

First, wo believe it measures recall rather tlmn recognition. 
Some researchers have said it is impossible to measure recall with 
an objective test — that all that can be done is to measure recog- 
nition. Wo disagree, and oiTcr the Memory for Sentences Tost 
as evidence. Next, our test measures materials which the student 
deliberately tries to memorize — that is, the test docs not meas- 
ure incidental memory. Furthermore, what it measures is some- 
thing more than immediate memory, sinco two other tests 
intervened between the study period and the test period. Finally, 
the test was designed to measure memory for material which is 
undcrlcamcd, rather than ovcrlcamcd. This material is verbal, 
consisting of sentences. 

Wo mention the kind of memory measured by this test be- 
cause it is easy (and risky) for test users to overgcncralizc from 
the title of a test and to infer, for instance, that because a test 
has the word “memory" in its title it will indicate how well some- 
one can do in all kinds of memory tasks. This is not so. There 
are several specific kinds of memory, and the results derived from 
a test of one kind should bo applied to other kinds only with 
great caution. 

This test is experimental in nature. Numerous tests of ability 
to memorize materials havo been developed in the past, but as 
far as wo know, llio typo of item used in tbc TALENT Memory 
for Sentences Test has not been used before in precisely tho snmo 
form. Tin’s item typo is a multiple-choice version of a kind of 
completion test that bad been developed to mcosuro essentially 
the same thing. This earlier test, developed at the Educational 
Testing Scrvico, consists of a study period in which a number of 
sentences are to bo memorized, followed by a testing j. jriod in 
which some or all of tho same sentences are presented in a differ- 
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cnt order, with one word missing from each. The task Is to fill 
In the missing word* 

The TALENT test for memory for sentences consists of 40 
short sentences. The students were given six minutes to mem- 
orize them. The test items consist of some of these sentences, in 
a different order, with one word omitted from each sentence, 
The task is to recall the missing word and identify its second 
letter, which is one of five options* Each option consists of only 
one letter, instead of an entire word, in order to test the ability 
to recall tho missing word, rather than merely the ability to 
recognize the word when it is presented. Tho second letter is 
used instead of the first in order to minimize the extent to which 
the letter itself will help tho person recall the missing word if 
lie has forgotten it* 

Those who do well on this kind of memory test arc probably 
likely to do well in types of school work that call for rote learn- 
ing of verbal materials, and they will also probably make good 
initial progress in training programs where a great deal of nomen- 
clature or many facts arc to be learned. 

The following sentence might have been used as one of the 
40 to be memorized: 

"Mary tried to catch the four 6 clock bus." 

If that sentence had been used, the following could have been 
one of the test items: 

Item 32. Mary to catch \the four o’clock bus. 

A. a 

E. _c 

I. i 

R r 

U. u 

(Tho answer is r — the second letter of "tried,") 

Note that many other words could be used to fill this space 
just as well, such as “wanted," “decided," “liked," or "hurried." 
However, tho word in tho sentence was “tried." 

Memory for Words 

The purpose of this test is to measure another kind of rote 
memory — tho ability to memorize “foreign" words correspond- 




